Apr 24 13:39:14 devstack cinder-volume[72334]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 24 13:39:14 devstack cinder-volume[72334]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 24 13:39:14 devstack cinder-volume[72334]: we strongly recommend against using it for new projects. Apr 24 13:39:14 devstack cinder-volume[72334]: If you are already using Eventlet, we recommend migrating to a different Apr 24 13:39:14 devstack cinder-volume[72334]: framework. For more detail see Apr 24 13:39:14 devstack cinder-volume[72334]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 24 13:39:14 devstack cinder-volume[72334]: import eventlet # noqa Apr 24 13:39:16 devstack cinder-volume[72334]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72334) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 13:39:16 devstack cinder-volume[72334]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72334) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 13:39:16 devstack cinder-volume[72334]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72334) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 13:39:17 devstack cinder-volume[72334]: INFO dbcounter [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] Registered counter for database cinder Apr 24 13:39:17 devstack cinder-volume[72334]: DEBUG oslo_db.sqlalchemy.engines [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72334) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 13:39:17 devstack cinder-volume[72334]: DEBUG dbcounter [-] [72334] Writer thread running {{(pid=72334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 24 13:39:17 devstack cinder-volume[72334]: INFO cinder.rpc [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 24 13:39:17 devstack cinder-volume[72334]: INFO cinder.rpc [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 24 13:39:17 devstack cinder-volume[72334]: DEBUG oslo_db.sqlalchemy.engines [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72334) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 13:39:17 devstack cinder-volume[72334]: INFO cinder.volume.manager [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] Determined volume DB was empty at startup. Apr 24 13:39:17 devstack cinder-volume[72334]: DEBUG cinder.volume.manager [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72334) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 24 13:39:17 devstack cinder-volume[72334]: INFO cinder.volume.manager [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 24 13:39:17 devstack cinder-volume[72334]: WARNING stevedore.named [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 24 13:39:17 devstack cinder-volume[72334]: WARNING castellan.key_manager [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 13:39:17 devstack cinder-volume[72334]: WARNING cinder.keymgr.conf_key_mgr [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 13:39:17 devstack cinder-volume[72334]: DEBUG cinder.volume.drivers.lvm [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72334) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 24 13:39:17 devstack cinder-volume[72334]: DEBUG oslo_concurrency.processutils [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_concurrency.processutils [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] CMD "cinder-rtstool verify" returned: 0 in 0.304s {{(pid=72334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_db.sqlalchemy.engines [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72334) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 13:39:18 devstack cinder-volume[72334]: INFO cinder.rpc [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 24 13:39:18 devstack cinder-volume[72334]: INFO cinder.rpc [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 24 13:39:18 devstack cinder-volume[72334]: WARNING stevedore.named [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 24 13:39:18 devstack cinder-volume[72334]: WARNING castellan.key_manager [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 13:39:18 devstack cinder-volume[72334]: INFO cinder.volume.manager [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_db.sqlalchemy.engines [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72334) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 13:39:18 devstack cinder-volume[72334]: INFO oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] Starting 1 workers Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] Started child 72440 {{(pid=72334) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] Full set of CONF: {{(pid=72334) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] ******************************************************************************** {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 24 13:39:18 devstack cinder-volume[72440]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] Configuration options gathered from: {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] ================================================================================ {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] allow_availability_zone_fallback = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] allow_compression_on_image_upload = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] allowed_direct_url_schemes = [] {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] api_rate_limit = True {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] auth_strategy = keystone {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] az_cache_duration = 3600 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_availability_zone = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_host = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_name = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_stats_polling_interval = 60 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backup_api_class = cinder.backup.api.API {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backup_name_template = backup-%s {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backup_use_same_host = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backup_use_temp_snapshot = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] chap_password = **** {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] chap_username = {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] cinder_internal_tenant_project_id = bcc0e50377b249579df09011f3e1267b {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] cinder_internal_tenant_user_id = a27f3a18eca245a1b474ca506760fd74 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] cloned_volume_same_az = True {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] cluster = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] compression_format = gzip {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] compute_api_class = cinder.compute.nova.API {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] config_dir = [] {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72440]: INFO cinder.volume.manager [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] config_source = [] {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] control_exchange = openstack {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] debug = True {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] default_availability_zone = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] default_group_type = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] default_volume_type = lvmdriver-1 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] disk_geometry = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] driver_client_cert = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] driver_client_cert_key = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] driver_data_namespace = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] driver_ssl_cert_path = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] driver_ssl_cert_verify = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] driver_use_ssl = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] enable_force_upload = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] enable_new_services = True {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] enable_unsupported_driver = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] enabled_backends = ['lvmdriver-1'] {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] enforce_multipath_for_image_xfer = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] filter_function = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] glance_api_insecure = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] glance_api_servers = ['http://192.168.122.171/image'] {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] glance_api_ssl_compression = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] glance_ca_certificates_file = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] glance_catalog_info = image:glance:publicURL {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] glance_certfile = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] glance_keyfile = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] glance_num_retries = 3 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] glance_request_timeout = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] goodness_function = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] graceful_shutdown_timeout = 5 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] group_api_class = cinder.group.api.API {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] host = devstack {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] image_compress_on_upload = True {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] image_conversion_address_space_limit = 1 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] image_conversion_cpu_limit = 60 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] image_conversion_disable = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] image_upload_use_cinder_backend = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] image_upload_use_internal_tenant = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] image_volume_cache_enabled = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] image_volume_cache_max_count = 0 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] image_volume_cache_max_size_gb = 0 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] init_host_max_objects_retrieval = 0 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] instance_format = [instance: %(uuid)s] {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] iscsi_target_flags = {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] iscsi_write_cache = on {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] iser_helper = tgtadm {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] iser_ip_address = 192.168.122.171 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] iser_port = 3260 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] log_color = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] log_config_append = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] log_dir = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] log_file = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] log_options = True {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] log_rotate_interval = 1 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] log_rotate_interval_type = days {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] log_rotation_type = none {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] max_age = 0 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] max_logfile_count = 30 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] max_logfile_size_mb = 200 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] max_over_subscription_ratio = 20.0 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] message_reap_interval = 86400 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] message_ttl = 2592000 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] migration_create_volume_timeout_secs = 300 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] monkey_patch = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] monkey_patch_modules = [] {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] my_ip = 192.168.122.171 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] no_snapshot_gb_quota = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] num_iser_scan_tries = 3 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] num_shell_tries = 3 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] num_volume_device_scan_tries = 3 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] nvmeof_conn_info_version = 1 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] nvmet_ns_id = 10 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] nvmet_port_id = 1 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] osapi_max_limit = 1000 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] osapi_volume_ext_list = [] {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] osapi_volume_listen = 0.0.0.0 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] osapi_volume_listen_port = 8776 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] osapi_volume_use_ssl = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] osapi_volume_workers = 2 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] per_volume_size_limit = -1 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] periodic_fuzzy_delay = 60 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] periodic_interval = 60 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] project_id_regex = [0-9a-f\-]+ {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] public_endpoint = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] publish_errors = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] quota_backup_gigabytes = 1000 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] quota_backups = 10 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] quota_gigabytes = 1000 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] quota_groups = 10 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] quota_snapshots = 10 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] quota_volumes = 10 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] rate_limit_burst = 0 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] rate_limit_except_level = CRITICAL {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] rate_limit_interval = 0 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] reinit_driver_count = 3 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] replication_device = **** {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] report_discard_supported = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] report_interval = 120 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] reservation_clean_interval = 86400 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] reservation_expire = 86400 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] reserved_image_namespaces = [] {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] reserved_percentage = 0 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] rpc_response_timeout = 120 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] run_external_periodic_tasks = True {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] scst_target_driver = iscsi {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] scst_target_iqn_name = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] service_down_time = 720 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] shell_completion = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] snapshot_name_template = snapshot-%s {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] snapshot_same_host = True {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] split_loggers = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] state_path = /opt/stack/data/cinder {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] storage_availability_zone = nova {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] storage_protocol = iSCSI {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] syslog_log_facility = LOG_USER {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] target_helper = lioadm {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] target_ip_address = 192.168.122.171 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] target_port = 3260 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] target_protocol = iscsi {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] target_secondary_ip_addresses = [] {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] trace_flags = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] transfer_api_class = cinder.transfer.api.API {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] transport_url = **** {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] until_refresh = 0 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] use_chap_auth = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] use_default_quota_class = True {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] use_journal = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] use_json = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] use_multipath_for_image_xfer = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] use_stderr = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] use_syslog = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] verify_glance_signatures = enabled {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack sudo[72445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 24 13:39:18 devstack sudo[72445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] volume_api_class = cinder.volume.api.API {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] volume_backend_name = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] volume_clear = zero {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] volume_clear_ionice = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] volume_clear_size = 0 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] volume_copy_bps_limit = 0 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] volume_dd_blocksize = 1M {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] volume_name_template = volume-%s {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] volume_service_inithost_offload = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] volume_usage_audit_period = month {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] zoning_mode = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_concurrency.disable_process_locking = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] keystone_authtoken.admin_password = **** {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] keystone_authtoken.admin_token = **** {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] keystone_authtoken.admin_user = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] keystone_authtoken.auth_admin_prefix = {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] keystone_authtoken.auth_port = 35357 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] keystone_authtoken.auth_protocol = https {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] keystone_authtoken.auth_section = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] keystone_authtoken.auth_type = password {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] keystone_authtoken.auth_uri = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] keystone_authtoken.auth_version = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] keystone_authtoken.cache = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] keystone_authtoken.certfile = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] keystone_authtoken.delay_auth_decision = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] keystone_authtoken.http_connect_timeout = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] keystone_authtoken.identity_uri = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] keystone_authtoken.include_service_catalog = True {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] keystone_authtoken.insecure = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] keystone_authtoken.interface = public {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] keystone_authtoken.keyfile = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] keystone_authtoken.memcache_password = {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] keystone_authtoken.memcache_username = {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] keystone_authtoken.region_name = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] keystone_authtoken.service_token_roles_required = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] keystone_authtoken.service_type = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] keystone_authtoken.token_cache_time = 300 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.171/identity {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] cache.backend = dogpile.cache.null {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] cache.backend_argument = **** {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] cache.backend_expiration_time = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] cache.config_prefix = cache.oslo {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] cache.debug_cache_backend = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] cache.enable_retry_client = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] cache.enable_socket_keepalive = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] cache.enabled = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] cache.enforce_fips_mode = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] cache.expiration_time = 600 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] cache.hashclient_dead_timeout = 60.0 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] cache.hashclient_retry_attempts = 2 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] cache.memcache_dead_retry = 300 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] cache.memcache_pool_maxsize = 10 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] cache.memcache_sasl_enabled = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] cache.memcache_servers = ['localhost:11211'] {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] cache.password = **** {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] cache.proxies = [] {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] cache.redis_db = 0 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] cache.redis_sentinel_service_name = mymaster {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] cache.redis_server = localhost:6379 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] cache.retry_attempts = 2 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] cache.retry_delay = 0.0 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] cache.socket_keepalive_count = 1 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] cache.socket_keepalive_idle = 1 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] cache.socket_keepalive_interval = 1 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] cache.socket_timeout = 1.0 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] cache.tls_allowed_ciphers = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] cache.tls_cafile = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] cache.tls_certfile = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] cache.tls_enabled = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] cache.tls_keyfile = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] cache.username = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] coordination.backend_url = **** {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] database.asyncio_connection = **** {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] database.asyncio_slave_connection = **** {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] database.backend = sqlalchemy {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] database.connection = **** {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] database.connection_debug = 0 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] database.connection_parameters = {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] database.connection_recycle_time = 3600 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] database.connection_trace = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] database.db_inc_retry_interval = True {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] database.db_max_retries = 20 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] database.db_max_retry_interval = 10 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] database.db_retry_interval = 1 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] database.max_overflow = 50 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] database.max_pool_size = 5 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] database.max_retries = 10 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] database.mysql_sql_mode = TRADITIONAL {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] database.mysql_wsrep_sync_wait = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] database.pool_timeout = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] database.retry_interval = 10 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] database.slave_connection = **** {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] database.sqlite_synchronous = True {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] database.synchronous_reader = True {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] database.use_db_reconnect = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_messaging_metrics.metrics_process_name = {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] profiler.connection_string = messaging:// {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] profiler.enabled = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] profiler.es_doc_type = notification {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] profiler.es_scroll_size = 10000 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] profiler.es_scroll_time = 2m {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] profiler.filter_error_trace = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] profiler.hmac_keys = **** {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] profiler.sentinel_service_name = mymaster {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] profiler.socket_timeout = 0.1 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] profiler.trace_requests = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] profiler.trace_sqlalchemy = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] profiler_jaeger.process_tags = {} {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] profiler_jaeger.service_name_prefix = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] profiler_otlp.service_name_prefix = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_policy.enforce_new_defaults = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: WARNING oslo_config.cfg [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_policy.enforce_scope = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_policy.policy_default_rule = default {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_policy.policy_file = policy.yaml {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_policy.remote_timeout = 60.0 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] privsep_osbrick.capabilities = [21, 2] {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] privsep_osbrick.group = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] privsep_osbrick.helper_command = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] privsep_osbrick.user = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] cinder_sys_admin.group = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] cinder_sys_admin.helper_command = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] cinder_sys_admin.user = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] service_user.auth_section = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] service_user.auth_type = password {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] service_user.cafile = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] service_user.certfile = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] service_user.collect_timing = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] service_user.insecure = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] service_user.keyfile = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] service_user.send_service_user_token = True {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] service_user.split_loggers = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] service_user.timeout = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] glance.auth_section = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] glance.auth_type = password {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] glance.certfile = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] glance.collect_timing = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] glance.insecure = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] glance.keyfile = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] glance.region_name = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] glance.split_loggers = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] glance.timeout = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.backend_availability_zone = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.chap_password = **** {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.chap_username = {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.disk_geometry = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.driver_client_cert = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.driver_client_cert_key = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.driver_data_namespace = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.driver_use_ssl = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.enable_unsupported_driver = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.extra_capabilities = {} {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.filter_function = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.goodness_function = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.iscsi_target_flags = {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.iscsi_write_cache = on {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.iser_helper = tgtadm {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.iser_ip_address = 192.168.122.171 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.iser_port = 3260 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.lvm_mirrors = 0 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.lvm_share_target = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.lvm_type = auto {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.num_shell_tries = 3 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.nvmet_ns_id = 10 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.nvmet_port_id = 1 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.replication_device = **** {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.report_discard_supported = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.reserved_percentage = 0 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.scst_target_driver = iscsi {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.scst_target_iqn_name = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.storage_protocol = iSCSI {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.target_helper = tgtadm {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.target_ip_address = 192.168.122.171 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.target_port = 3260 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.target_protocol = iscsi {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.trace_flags = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.unique_fqdn_network = True {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.use_chap_auth = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.volume_backend_name = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.volume_clear = zero {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.volume_clear_ionice = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.volume_clear_size = 0 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.volume_group = cinder-volumes {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_reports.file_event_handler = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_reports.log_dir = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.backend_availability_zone = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.backend_host = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.chap_password = **** {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.chap_username = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.chiscsi_conf = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.disk_geometry = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.driver_client_cert = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.driver_data_namespace = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.driver_use_ssl = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.extra_capabilities = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.filter_function = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.goodness_function = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.iscsi_write_cache = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.iser_helper = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.iser_ip_address = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.iser_port = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.iser_target_prefix = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.lvm_conf_file = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.lvm_mirrors = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.lvm_share_target = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.lvm_type = auto {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.num_shell_tries = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.nvmet_ns_id = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.nvmet_port_id = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.replication_device = **** {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.report_discard_supported = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.reserved_percentage = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.scst_target_driver = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.storage_protocol = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.target_helper = lioadm {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.target_ip_address = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.target_port = 3260 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.target_protocol = iscsi {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.trace_flags = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.use_chap_auth = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.volume_clear = zero {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.volume_clear_size = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] lvmdriver-1.volumes_dir = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_messaging_rabbit.ssl = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_messaging_rabbit.ssl_version = {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_messaging_notifications.driver = [] {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_messaging_notifications.retry = -1 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] oslo_messaging_notifications.transport_url = **** {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] key_manager.fixed_key = **** {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] barbican.barbican_api_version = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] barbican.barbican_endpoint = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] barbican.barbican_endpoint_type = public {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] barbican.barbican_region_name = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] barbican.cafile = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] barbican.certfile = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] barbican.collect_timing = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] barbican.insecure = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] barbican.keyfile = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] barbican.number_of_retries = 60 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] barbican.retry_delay = 1 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] barbican.send_service_user_token = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] barbican.split_loggers = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] barbican.timeout = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] barbican.verify_ssl = True {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] barbican.verify_ssl_path = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] barbican_service_user.auth_section = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] barbican_service_user.auth_type = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] barbican_service_user.cafile = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] barbican_service_user.certfile = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] barbican_service_user.collect_timing = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] barbican_service_user.insecure = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] barbican_service_user.keyfile = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] barbican_service_user.split_loggers = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] barbican_service_user.timeout = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] vault.approle_role_id = **** {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] vault.approle_secret_id = **** {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] vault.kv_mountpoint = secret {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] vault.kv_path = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] vault.kv_version = 2 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] vault.namespace = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] vault.root_token_id = **** {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] vault.ssl_ca_crt_file = None {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] vault.timeout = 60.0 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] vault.use_ssl = False {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:39:18 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] ******************************************************************************** {{(pid=72334) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 24 13:39:18 devstack sudo[72445]: pam_unix(sudo:session): session closed for user root Apr 24 13:39:18 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.646s {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:39:18 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:39:18 devstack sudo[72454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 13:39:18 devstack sudo[72454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:39:19 devstack sudo[72454]: pam_unix(sudo:session): session closed for user root Apr 24 13:39:19 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.666s {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:39:19 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 13:39:19 devstack cinder-volume[72440]: INFO cinder.brick.local_dev.lvm [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 24 13:39:19 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:39:19 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:39:19 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:39:19 devstack sudo[72642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 13:39:19 devstack sudo[72642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:39:20 devstack sudo[72642]: pam_unix(sudo:session): session closed for user root Apr 24 13:39:20 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.536s {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:39:20 devstack cinder-volume[72440]: DEBUG cinder.brick.local_dev.lvm [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72440) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 24 13:39:20 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:39:20 devstack sudo[72791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 13:39:20 devstack sudo[72791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:39:21 devstack sudo[72791]: pam_unix(sudo:session): session closed for user root Apr 24 13:39:21 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.803s {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:39:21 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:39:21 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:39:21 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:39:22 devstack sudo[73131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 13:39:22 devstack sudo[73131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:39:22 devstack sudo[73131]: pam_unix(sudo:session): session closed for user root Apr 24 13:39:22 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.785s {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:39:22 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:39:22 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:39:22 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:39:22 devstack sudo[73171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 24 13:39:22 devstack sudo[73171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:39:23 devstack sudo[73171]: pam_unix(sudo:session): session closed for user root Apr 24 13:39:23 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.555s {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:39:23 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:39:23 devstack sudo[73174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 13:39:23 devstack sudo[73174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:39:23 devstack sudo[73174]: pam_unix(sudo:session): session closed for user root Apr 24 13:39:23 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.600s {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:39:23 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:39:23 devstack sudo[73182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 13:39:23 devstack sudo[73182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:39:24 devstack sudo[73182]: pam_unix(sudo:session): session closed for user root Apr 24 13:39:24 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.599s {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:39:24 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:39:24 devstack sudo[73185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 13:39:24 devstack sudo[73185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:39:25 devstack sudo[73185]: pam_unix(sudo:session): session closed for user root Apr 24 13:39:25 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.521s {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:39:25 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:39:25 devstack sudo[73190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 13:39:25 devstack sudo[73190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:39:25 devstack sudo[73190]: pam_unix(sudo:session): session closed for user root Apr 24 13:39:25 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.579s {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:39:25 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:39:25 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:39:25 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:39:25 devstack sudo[73195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 13:39:25 devstack sudo[73195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:39:26 devstack sudo[73195]: pam_unix(sudo:session): session closed for user root Apr 24 13:39:26 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.701s {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:39:26 devstack cinder-volume[72440]: INFO cinder.volume.drivers.lvm [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 24 13:39:26 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:39:26 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:39:26 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:39:26 devstack sudo[73249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 13:39:26 devstack sudo[73249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:39:26 devstack sudo[73249]: pam_unix(sudo:session): session closed for user root Apr 24 13:39:26 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.494s {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:39:26 devstack cinder-volume[72440]: DEBUG cinder.volume.drivers.lvm [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] Updating volume stats {{(pid=72440) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 24 13:39:26 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:39:26 devstack sudo[73322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 13:39:26 devstack sudo[73322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:39:27 devstack sudo[73322]: pam_unix(sudo:session): session closed for user root Apr 24 13:39:27 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.556s {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:39:27 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:39:27 devstack sudo[73411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 13:39:27 devstack sudo[73411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:39:27 devstack sudo[73411]: pam_unix(sudo:session): session closed for user root Apr 24 13:39:27 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.528s {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:39:27 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:39:28 devstack sudo[73466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 13:39:28 devstack sudo[73466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:39:28 devstack cinder-volume[72334]: DEBUG dbcounter [-] [72334] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 13:39:28 devstack sudo[73466]: pam_unix(sudo:session): session closed for user root Apr 24 13:39:28 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.504s {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:39:28 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:39:28 devstack sudo[73473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 13:39:28 devstack sudo[73473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:39:28 devstack sudo[73473]: pam_unix(sudo:session): session closed for user root Apr 24 13:39:28 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.479s {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:39:28 devstack cinder-volume[72440]: INFO cinder.volume.driver [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] Driver hasn't implemented _init_vendor_properties() Apr 24 13:39:28 devstack cinder-volume[72440]: DEBUG cinder.volume.driver [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72440) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 24 13:39:29 devstack cinder-volume[72440]: DEBUG oslo_db.sqlalchemy.engines [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72440) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 13:39:29 devstack cinder-volume[72440]: DEBUG dbcounter [-] [72440] Writer thread running {{(pid=72440) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 24 13:39:29 devstack cinder-volume[72440]: DEBUG cinder.db.sqlalchemy.api [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] Building query based on filter {{(pid=72440) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 24 13:39:29 devstack cinder-volume[72440]: DEBUG cinder.image.image_utils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72440) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 24 13:39:29 devstack cinder-volume[72440]: INFO cinder.keymgr.migration [None req-1a95332a-3f79-4dd3-beb1-02fe92d57c66 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 24 13:39:29 devstack cinder-volume[72440]: DEBUG cinder.volume.drivers.lvm [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] Updating volume stats {{(pid=72440) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 24 13:39:29 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:39:29 devstack sudo[73478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 13:39:29 devstack sudo[73478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:39:29 devstack sudo[73478]: pam_unix(sudo:session): session closed for user root Apr 24 13:39:29 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.505s {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:39:29 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:39:29 devstack sudo[73481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 13:39:29 devstack sudo[73481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:39:30 devstack sudo[73481]: pam_unix(sudo:session): session closed for user root Apr 24 13:39:30 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.561s {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:39:30 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:39:30 devstack sudo[73484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 13:39:30 devstack sudo[73484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:39:30 devstack sudo[73484]: pam_unix(sudo:session): session closed for user root Apr 24 13:39:30 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.557s {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:39:30 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:39:30 devstack sudo[73491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 13:39:30 devstack sudo[73491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:39:31 devstack sudo[73491]: pam_unix(sudo:session): session closed for user root Apr 24 13:39:31 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.576s {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:39:31 devstack cinder-volume[72440]: DEBUG cinder.manager [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] Notifying Schedulers of capabilities ... {{(pid=72440) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:39:31 devstack cinder-volume[72440]: INFO cinder.volume.manager [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] Driver initialization completed successfully. Apr 24 13:39:31 devstack cinder-volume[72440]: INFO cinder.manager [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] Initiating service 2 cleanup Apr 24 13:39:31 devstack cinder-volume[72440]: INFO cinder.manager [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] Service 2 cleanup completed. Apr 24 13:39:31 devstack cinder-volume[72440]: DEBUG cinder.service [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] Creating RPC server for service cinder-volume {{(pid=72440) start /opt/stack/cinder/cinder/service.py:231}} Apr 24 13:39:31 devstack cinder-volume[72440]: DEBUG cinder.service [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72440) start /opt/stack/cinder/cinder/service.py:237}} Apr 24 13:39:31 devstack cinder-volume[72440]: INFO cinder.volume.manager [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 24 13:39:31 devstack cinder-volume[72440]: DEBUG cinder.volume.drivers.lvm [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] Updating volume stats {{(pid=72440) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 24 13:39:31 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:39:31 devstack sudo[73496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 13:39:31 devstack sudo[73496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:39:32 devstack sudo[73496]: pam_unix(sudo:session): session closed for user root Apr 24 13:39:32 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.553s {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:39:32 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:39:32 devstack sudo[73502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 13:39:32 devstack sudo[73502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:39:32 devstack sudo[73502]: pam_unix(sudo:session): session closed for user root Apr 24 13:39:32 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.518s {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:39:32 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:39:32 devstack sudo[73505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 13:39:32 devstack sudo[73505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:39:33 devstack sudo[73505]: pam_unix(sudo:session): session closed for user root Apr 24 13:39:33 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.472s {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:39:33 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:39:33 devstack sudo[73690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 13:39:33 devstack sudo[73690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:39:33 devstack sudo[73690]: pam_unix(sudo:session): session closed for user root Apr 24 13:39:33 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.493s {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:39:33 devstack cinder-volume[72440]: INFO cinder.volume.manager [None req-93fe73c2-4dd0-4230-9b3a-d0d5da0b16f3 None None] Driver post RPC initialization completed successfully. Apr 24 13:39:43 devstack cinder-volume[72440]: DEBUG dbcounter [-] [72440] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72440) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 13:39:43 devstack cinder-volume[72440]: DEBUG dbcounter [-] [72440] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=72440) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 13:40:47 devstack cinder-volume[72440]: DEBUG oslo_service.periodic_task [None req-52ada4b7-19aa-4a62-8313-ea52bf577e9a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72440) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 13:40:47 devstack cinder-volume[72440]: DEBUG cinder.volume.drivers.lvm [None req-52ada4b7-19aa-4a62-8313-ea52bf577e9a None None] Updating volume stats {{(pid=72440) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 24 13:40:47 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-52ada4b7-19aa-4a62-8313-ea52bf577e9a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:40:47 devstack sudo[78293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 13:40:47 devstack sudo[78293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:40:48 devstack sudo[78293]: pam_unix(sudo:session): session closed for user root Apr 24 13:40:48 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-52ada4b7-19aa-4a62-8313-ea52bf577e9a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.504s {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:40:48 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-52ada4b7-19aa-4a62-8313-ea52bf577e9a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:40:48 devstack sudo[78296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 13:40:48 devstack sudo[78296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:40:48 devstack sudo[78296]: pam_unix(sudo:session): session closed for user root Apr 24 13:40:48 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-52ada4b7-19aa-4a62-8313-ea52bf577e9a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.486s {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:40:48 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-52ada4b7-19aa-4a62-8313-ea52bf577e9a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:40:48 devstack sudo[78299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 13:40:48 devstack sudo[78299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:40:49 devstack sudo[78299]: pam_unix(sudo:session): session closed for user root Apr 24 13:40:49 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-52ada4b7-19aa-4a62-8313-ea52bf577e9a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.521s {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:40:49 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-52ada4b7-19aa-4a62-8313-ea52bf577e9a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:40:49 devstack sudo[78302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 13:40:49 devstack sudo[78302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:40:49 devstack sudo[78302]: pam_unix(sudo:session): session closed for user root Apr 24 13:40:49 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-52ada4b7-19aa-4a62-8313-ea52bf577e9a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.505s {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:40:49 devstack cinder-volume[72440]: DEBUG cinder.manager [None req-52ada4b7-19aa-4a62-8313-ea52bf577e9a None None] Notifying Schedulers of capabilities ... {{(pid=72440) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:41:43 devstack cinder-volume[72440]: DEBUG dbcounter [-] [72440] Writing DB stats cinder:SELECT=1 {{(pid=72440) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 13:41:43 devstack cinder-volume[72440]: DEBUG dbcounter [-] [72440] Writing DB stats cinder:UPDATE=1 {{(pid=72440) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 13:41:47 devstack cinder-volume[72440]: DEBUG oslo_service.periodic_task [None req-52ada4b7-19aa-4a62-8313-ea52bf577e9a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72440) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 13:41:47 devstack cinder-volume[72440]: DEBUG cinder.volume.drivers.lvm [None req-52ada4b7-19aa-4a62-8313-ea52bf577e9a None None] Updating volume stats {{(pid=72440) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 24 13:41:47 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-52ada4b7-19aa-4a62-8313-ea52bf577e9a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:41:47 devstack sudo[79327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 13:41:47 devstack sudo[79327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:41:48 devstack sudo[79327]: pam_unix(sudo:session): session closed for user root Apr 24 13:41:48 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-52ada4b7-19aa-4a62-8313-ea52bf577e9a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.457s {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:41:48 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-52ada4b7-19aa-4a62-8313-ea52bf577e9a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:41:48 devstack sudo[79344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 13:41:48 devstack sudo[79344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:41:48 devstack sudo[79344]: pam_unix(sudo:session): session closed for user root Apr 24 13:41:48 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-52ada4b7-19aa-4a62-8313-ea52bf577e9a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.492s {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:41:48 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-52ada4b7-19aa-4a62-8313-ea52bf577e9a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:41:48 devstack sudo[79359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 13:41:48 devstack sudo[79359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:41:49 devstack sudo[79359]: pam_unix(sudo:session): session closed for user root Apr 24 13:41:49 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-52ada4b7-19aa-4a62-8313-ea52bf577e9a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.497s {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:41:49 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-52ada4b7-19aa-4a62-8313-ea52bf577e9a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:41:49 devstack sudo[79385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 13:41:49 devstack sudo[79385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:41:49 devstack sudo[79385]: pam_unix(sudo:session): session closed for user root Apr 24 13:41:49 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-52ada4b7-19aa-4a62-8313-ea52bf577e9a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.471s {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:41:49 devstack cinder-volume[72440]: DEBUG cinder.manager [None req-52ada4b7-19aa-4a62-8313-ea52bf577e9a None None] Notifying Schedulers of capabilities ... {{(pid=72440) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:42:47 devstack cinder-volume[72440]: DEBUG oslo_service.periodic_task [None req-52ada4b7-19aa-4a62-8313-ea52bf577e9a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72440) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 13:42:47 devstack cinder-volume[72440]: DEBUG cinder.volume.drivers.lvm [None req-52ada4b7-19aa-4a62-8313-ea52bf577e9a None None] Updating volume stats {{(pid=72440) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 24 13:42:47 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-52ada4b7-19aa-4a62-8313-ea52bf577e9a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:42:47 devstack sudo[80834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 24 13:42:47 devstack sudo[80834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:42:48 devstack sudo[80834]: pam_unix(sudo:session): session closed for user root Apr 24 13:42:48 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-52ada4b7-19aa-4a62-8313-ea52bf577e9a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.513s {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:42:48 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-52ada4b7-19aa-4a62-8313-ea52bf577e9a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:42:48 devstack sudo[80837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 13:42:48 devstack sudo[80837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:42:48 devstack sudo[80837]: pam_unix(sudo:session): session closed for user root Apr 24 13:42:48 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-52ada4b7-19aa-4a62-8313-ea52bf577e9a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.556s {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:42:48 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-52ada4b7-19aa-4a62-8313-ea52bf577e9a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:42:48 devstack sudo[80841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 24 13:42:48 devstack sudo[80841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:42:49 devstack sudo[80841]: pam_unix(sudo:session): session closed for user root Apr 24 13:42:49 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-52ada4b7-19aa-4a62-8313-ea52bf577e9a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.536s {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:42:49 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-52ada4b7-19aa-4a62-8313-ea52bf577e9a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:42:49 devstack sudo[80861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 24 13:42:49 devstack sudo[80861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:42:49 devstack sudo[80861]: pam_unix(sudo:session): session closed for user root Apr 24 13:42:49 devstack cinder-volume[72440]: DEBUG oslo_concurrency.processutils [None req-52ada4b7-19aa-4a62-8313-ea52bf577e9a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.518s {{(pid=72440) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:42:49 devstack cinder-volume[72440]: DEBUG cinder.manager [None req-52ada4b7-19aa-4a62-8313-ea52bf577e9a None None] Notifying Schedulers of capabilities ... {{(pid=72440) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:43:15 devstack cinder-volume[72334]: INFO oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] Caught SIGTERM, stopping children Apr 24 13:43:15 devstack cinder-volume[72334]: DEBUG oslo_concurrency.lockutils [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] Acquiring lock "singleton_lock" {{(pid=72334) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 13:43:15 devstack cinder-volume[72334]: DEBUG oslo_concurrency.lockutils [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] Acquired lock "singleton_lock" {{(pid=72334) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 13:43:15 devstack cinder-volume[72334]: DEBUG oslo_concurrency.lockutils [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] Releasing lock "singleton_lock" {{(pid=72334) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 13:43:15 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] Stop services. {{(pid=72334) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 24 13:43:15 devstack cinder-volume[72334]: DEBUG oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] Killing children. {{(pid=72334) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 24 13:43:15 devstack cinder-volume[72334]: INFO oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] Waiting on 1 children to exit Apr 24 13:43:16 devstack cinder-volume[72440]: DEBUG oslo_concurrency.lockutils [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] Acquiring lock "singleton_lock" {{(pid=72440) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 13:43:16 devstack cinder-volume[72440]: DEBUG oslo_concurrency.lockutils [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] Acquired lock "singleton_lock" {{(pid=72440) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 13:43:16 devstack cinder-volume[72440]: DEBUG oslo_concurrency.lockutils [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] Releasing lock "singleton_lock" {{(pid=72440) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 13:43:16 devstack cinder-volume[72440]: WARNING amqp [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 24 13:43:16 devstack cinder-volume[72440]: WARNING amqp [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 24 13:43:16 devstack cinder-volume[72334]: INFO oslo_service.backend._eventlet.service [None req-34d19ba6-aa8b-4bfc-bace-f4f0d23cfcbf None None] Child 72440 exited with status 0 Apr 24 13:43:16 devstack cinder-volume[81456]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 24 13:43:16 devstack cinder-volume[81456]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 24 13:43:16 devstack cinder-volume[81456]: we strongly recommend against using it for new projects. Apr 24 13:43:16 devstack cinder-volume[81456]: If you are already using Eventlet, we recommend migrating to a different Apr 24 13:43:16 devstack cinder-volume[81456]: framework. For more detail see Apr 24 13:43:16 devstack cinder-volume[81456]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 24 13:43:16 devstack cinder-volume[81456]: import eventlet # noqa Apr 24 13:43:19 devstack cinder-volume[81456]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81456) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 13:43:19 devstack cinder-volume[81456]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81456) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 13:43:19 devstack cinder-volume[81456]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81456) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 13:43:19 devstack cinder-volume[81456]: INFO dbcounter [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] Registered counter for database cinder Apr 24 13:43:19 devstack cinder-volume[81456]: DEBUG oslo_db.sqlalchemy.engines [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81456) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 13:43:19 devstack cinder-volume[81456]: DEBUG dbcounter [-] [81456] Writer thread running {{(pid=81456) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 24 13:43:19 devstack cinder-volume[81456]: INFO cinder.rpc [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 24 13:43:19 devstack cinder-volume[81456]: INFO cinder.rpc [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 24 13:43:19 devstack cinder-volume[81456]: DEBUG oslo_db.sqlalchemy.engines [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81456) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 13:43:19 devstack cinder-volume[81456]: INFO cinder.volume.manager [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] Determined volume DB was empty at startup. Apr 24 13:43:19 devstack cinder-volume[81456]: DEBUG cinder.volume.manager [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81456) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 24 13:43:19 devstack cinder-volume[81456]: INFO cinder.volume.manager [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 24 13:43:19 devstack cinder-volume[81456]: WARNING stevedore.named [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 24 13:43:19 devstack cinder-volume[81456]: WARNING castellan.key_manager [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 13:43:19 devstack cinder-volume[81456]: WARNING cinder.keymgr.conf_key_mgr [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 13:43:19 devstack cinder-volume[81456]: INFO cinder.volume.manager [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 24 13:43:19 devstack cinder-volume[81456]: DEBUG oslo_db.sqlalchemy.engines [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81456) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 13:43:20 devstack cinder-volume[81456]: INFO oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] Starting 1 workers Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] Started child 81575 {{(pid=81456) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] Full set of CONF: {{(pid=81456) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] ******************************************************************************** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] Configuration options gathered from: {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] ================================================================================ {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] allow_availability_zone_fallback = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] allow_compression_on_image_upload = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] allowed_direct_url_schemes = [] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] api_rate_limit = True {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] auth_strategy = keystone {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_availability_zone = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_host = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_name = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_stats_polling_interval = 60 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backup_api_class = cinder.backup.api.API {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backup_name_template = backup-%s {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backup_use_same_host = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backup_use_temp_snapshot = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] chap_password = **** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] chap_username = {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] cinder_internal_tenant_project_id = bcc0e50377b249579df09011f3e1267b {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] cinder_internal_tenant_user_id = a27f3a18eca245a1b474ca506760fd74 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] cluster = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] compression_format = gzip {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] compute_api_class = cinder.compute.nova.API {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] config_dir = [] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] config_source = [] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] control_exchange = openstack {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] debug = True {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81575]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] default_availability_zone = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] default_group_type = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] default_volume_type = QuobyteHD {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] disk_geometry = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] driver_client_cert = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] driver_client_cert_key = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] driver_data_namespace = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] driver_ssl_cert_path = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] driver_ssl_cert_verify = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] driver_use_ssl = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] enable_new_services = True {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] enable_unsupported_driver = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] enabled_backends = ['QuobyteHD'] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] enforce_multipath_for_image_xfer = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] filter_function = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] glance_api_insecure = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] glance_api_servers = ['http://192.168.122.171/image'] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] glance_api_ssl_compression = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] glance_ca_certificates_file = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] glance_catalog_info = image:glance:publicURL {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] glance_certfile = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] glance_keyfile = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] glance_num_retries = 3 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] glance_request_timeout = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] goodness_function = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] graceful_shutdown_timeout = 5 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] group_api_class = cinder.group.api.API {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] host = devstack {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] image_compress_on_upload = True {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] image_conversion_address_space_limit = 1 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] image_conversion_cpu_limit = 60 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] image_conversion_disable = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] image_upload_use_cinder_backend = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] image_upload_use_internal_tenant = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] image_volume_cache_enabled = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] image_volume_cache_max_count = 0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] image_volume_cache_max_size_gb = 0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] init_host_max_objects_retrieval = 0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] instance_format = [instance: %(uuid)s] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] iscsi_target_flags = {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] iscsi_write_cache = on {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] iser_helper = tgtadm {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] iser_ip_address = 192.168.122.171 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] iser_port = 3260 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] log_color = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] log_config_append = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] log_dir = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] log_file = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] log_options = True {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] log_rotate_interval = 1 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] log_rotate_interval_type = days {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] log_rotation_type = none {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] max_age = 0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] max_logfile_count = 30 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] max_logfile_size_mb = 200 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] max_over_subscription_ratio = 20.0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] message_reap_interval = 86400 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] message_ttl = 2592000 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] migration_create_volume_timeout_secs = 300 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] monkey_patch = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] monkey_patch_modules = [] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] my_ip = 192.168.122.171 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] no_snapshot_gb_quota = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] num_iser_scan_tries = 3 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] num_shell_tries = 3 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] num_volume_device_scan_tries = 3 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] nvmeof_conn_info_version = 1 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] nvmet_ns_id = 10 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] nvmet_port_id = 1 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] osapi_max_limit = 1000 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] osapi_volume_ext_list = [] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] osapi_volume_listen = 0.0.0.0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] osapi_volume_listen_port = 8776 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] osapi_volume_use_ssl = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] osapi_volume_workers = 2 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] per_volume_size_limit = -1 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] periodic_fuzzy_delay = 60 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] periodic_interval = 60 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] project_id_regex = [0-9a-f\-]+ {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] public_endpoint = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] publish_errors = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] quota_backup_gigabytes = 1000 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] quota_backups = 10 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] quota_gigabytes = 1000 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] quota_groups = 10 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] quota_snapshots = 10 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] quota_volumes = 10 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] rate_limit_burst = 0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] rate_limit_except_level = CRITICAL {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] rate_limit_interval = 0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] reinit_driver_count = 3 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] replication_device = **** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] report_discard_supported = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] report_interval = 120 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] reservation_clean_interval = 86400 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] reservation_expire = 86400 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] reserved_image_namespaces = [] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] reserved_percentage = 0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] rpc_response_timeout = 120 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] run_external_periodic_tasks = True {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] scst_target_driver = iscsi {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] scst_target_iqn_name = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] service_down_time = 720 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] shell_completion = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] snapshot_name_template = snapshot-%s {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] split_loggers = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] state_path = /opt/stack/data/cinder {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] storage_availability_zone = nova {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] storage_protocol = iSCSI {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] syslog_log_facility = LOG_USER {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] target_helper = lioadm {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] target_ip_address = 192.168.122.171 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] target_port = 3260 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] target_protocol = iscsi {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] target_secondary_ip_addresses = [] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] trace_flags = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] transfer_api_class = cinder.transfer.api.API {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] transport_url = **** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] until_refresh = 0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] use_chap_auth = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] use_default_quota_class = True {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] use_journal = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] use_json = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] use_multipath_for_image_xfer = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] use_stderr = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] use_syslog = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] verify_glance_signatures = enabled {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] volume_api_class = cinder.volume.api.API {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] volume_backend_name = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] volume_clear = zero {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] volume_clear_ionice = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] volume_clear_size = 0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] volume_copy_bps_limit = 0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] volume_dd_blocksize = 1M {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] volume_name_template = volume-%s {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] volume_service_inithost_offload = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] volume_usage_audit_period = month {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] zoning_mode = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_concurrency.disable_process_locking = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] keystone_authtoken.admin_password = **** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] keystone_authtoken.admin_token = **** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] keystone_authtoken.admin_user = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] keystone_authtoken.auth_admin_prefix = {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] keystone_authtoken.auth_port = 35357 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] keystone_authtoken.auth_protocol = https {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] keystone_authtoken.auth_section = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] keystone_authtoken.auth_type = password {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] keystone_authtoken.auth_uri = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] keystone_authtoken.auth_version = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] keystone_authtoken.cache = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] keystone_authtoken.certfile = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] keystone_authtoken.identity_uri = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] keystone_authtoken.include_service_catalog = True {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] keystone_authtoken.insecure = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] keystone_authtoken.interface = public {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] keystone_authtoken.keyfile = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] keystone_authtoken.memcache_password = {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] keystone_authtoken.memcache_username = {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] keystone_authtoken.region_name = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] keystone_authtoken.service_type = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.171/identity {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] cache.backend = dogpile.cache.null {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] cache.backend_argument = **** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] cache.backend_expiration_time = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] cache.config_prefix = cache.oslo {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] cache.debug_cache_backend = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] cache.enable_retry_client = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] cache.enable_socket_keepalive = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] cache.enabled = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] cache.enforce_fips_mode = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] cache.expiration_time = 600 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] cache.hashclient_retry_attempts = 2 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] cache.memcache_dead_retry = 300 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] cache.memcache_pool_maxsize = 10 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] cache.memcache_sasl_enabled = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] cache.password = **** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] cache.proxies = [] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] cache.redis_db = 0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] cache.redis_server = localhost:6379 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] cache.retry_attempts = 2 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] cache.retry_delay = 0.0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] cache.socket_keepalive_count = 1 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] cache.socket_keepalive_idle = 1 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] cache.socket_keepalive_interval = 1 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] cache.socket_timeout = 1.0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] cache.tls_allowed_ciphers = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] cache.tls_cafile = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] cache.tls_certfile = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] cache.tls_enabled = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] cache.tls_keyfile = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] cache.username = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] coordination.backend_url = **** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] database.asyncio_connection = **** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] database.asyncio_slave_connection = **** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] database.backend = sqlalchemy {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] database.connection = **** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] database.connection_debug = 0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] database.connection_parameters = {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] database.connection_recycle_time = 3600 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] database.connection_trace = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] database.db_inc_retry_interval = True {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] database.db_max_retries = 20 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] database.db_max_retry_interval = 10 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] database.db_retry_interval = 1 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] database.max_overflow = 50 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] database.max_pool_size = 5 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] database.max_retries = 10 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] database.mysql_wsrep_sync_wait = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] database.pool_timeout = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] database.retry_interval = 10 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] database.slave_connection = **** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] database.sqlite_synchronous = True {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] database.synchronous_reader = True {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] database.use_db_reconnect = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] profiler.connection_string = messaging:// {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] profiler.enabled = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] profiler.es_doc_type = notification {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] profiler.es_scroll_size = 10000 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] profiler.es_scroll_time = 2m {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] profiler.filter_error_trace = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] profiler.hmac_keys = **** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] profiler.sentinel_service_name = mymaster {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] profiler.socket_timeout = 0.1 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] profiler.trace_requests = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] profiler.trace_sqlalchemy = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] profiler_jaeger.process_tags = {} {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] profiler_jaeger.service_name_prefix = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] profiler_otlp.service_name_prefix = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_policy.enforce_new_defaults = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: WARNING oslo_config.cfg [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_policy.enforce_scope = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_policy.policy_default_rule = default {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_policy.policy_file = policy.yaml {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_policy.remote_timeout = 60.0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] privsep_osbrick.group = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] privsep_osbrick.helper_command = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] privsep_osbrick.user = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] cinder_sys_admin.group = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] cinder_sys_admin.helper_command = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] cinder_sys_admin.user = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] service_user.auth_section = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] service_user.auth_type = password {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] service_user.cafile = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] service_user.certfile = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] service_user.collect_timing = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] service_user.insecure = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] service_user.keyfile = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] service_user.send_service_user_token = True {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] service_user.split_loggers = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] service_user.timeout = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] glance.auth_section = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] glance.auth_type = password {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] glance.certfile = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] glance.collect_timing = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] glance.insecure = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] glance.keyfile = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] glance.region_name = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] glance.split_loggers = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] glance.timeout = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.backend_availability_zone = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.chap_password = **** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.chap_username = {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.disk_geometry = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.driver_client_cert = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.driver_client_cert_key = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.driver_data_namespace = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.driver_use_ssl = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.extra_capabilities = {} {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.filter_function = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.goodness_function = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.iscsi_target_flags = {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.iscsi_write_cache = on {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.iser_helper = tgtadm {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.iser_ip_address = 192.168.122.171 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.iser_port = 3260 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.nas_host = {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.nas_login = admin {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.nas_mount_options = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.nas_password = **** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.nas_private_key = {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81575]: INFO cinder.volume.manager [None req-f87e5059-a08e-4d5a-a2e8-c79a3d6df9bd None None] Starting volume driver QuobyteDriver (1.1.14) Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81575]: DEBUG cinder.volume.drivers.remotefs [None req-f87e5059-a08e-4d5a-a2e8-c79a3d6df9bd None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81575) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.nas_share_path = {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.nas_ssh_port = 22 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.num_shell_tries = 3 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.quobyte_client_cfg = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.quobyte_volume_url = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.replication_device = **** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.report_discard_supported = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.reserved_percentage = 0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.target_helper = tgtadm {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.target_ip_address = 192.168.122.171 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.target_port = 3260 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.target_protocol = iscsi {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.trace_flags = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.unique_fqdn_network = True {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.use_chap_auth = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.volume_backend_name = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.volume_clear = zero {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.volume_clear_ionice = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.volume_clear_size = 0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_reports.file_event_handler = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_reports.log_dir = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.backend_availability_zone = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.backend_host = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.chap_password = **** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.chap_username = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.chiscsi_conf = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.disk_geometry = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.driver_client_cert = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.driver_client_cert_key = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.driver_data_namespace = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.driver_use_ssl = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.extra_capabilities = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.filter_function = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.goodness_function = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.iscsi_target_flags = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.iscsi_write_cache = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.iser_helper = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.iser_ip_address = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.iser_port = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.iser_target_prefix = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.nas_host = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.nas_login = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.nas_mount_options = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.nas_password = **** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.nas_private_key = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.nas_share_path = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.nas_ssh_port = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.num_shell_tries = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.nvmet_ns_id = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.nvmet_port_id = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81575]: DEBUG cinder.volume.drivers.quobyte [None req-f87e5059-a08e-4d5a-a2e8-c79a3d6df9bd None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81575) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 24 13:43:20 devstack cinder-volume[81575]: WARNING cinder.volume.drivers.quobyte [None req-f87e5059-a08e-4d5a-a2e8-c79a3d6df9bd None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 24 13:43:20 devstack cinder-volume[81575]: WARNING cinder.volume.drivers.quobyte [None req-f87e5059-a08e-4d5a-a2e8-c79a3d6df9bd None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81575]: DEBUG oslo_concurrency.processutils [None req-f87e5059-a08e-4d5a-a2e8-c79a3d6df9bd None None] Running cmd (subprocess): mount.quobyte {{(pid=81575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.replication_device = **** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.report_discard_supported = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.reserved_percentage = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.scst_target_driver = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.storage_protocol = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.target_helper = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.target_ip_address = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.target_port = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.target_prefix = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.target_protocol = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.trace_flags = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.unique_fqdn_network = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.use_chap_auth = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.volume_clear = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.volume_clear_ionice = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.volume_clear_size = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] QuobyteHD.volumes_dir = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_messaging_rabbit.ssl = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_messaging_rabbit.ssl_version = {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_messaging_notifications.driver = [] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_messaging_notifications.retry = -1 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] key_manager.fixed_key = **** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] barbican.barbican_api_version = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] barbican.barbican_endpoint = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] barbican.barbican_endpoint_type = public {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] barbican.barbican_region_name = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] barbican.cafile = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] barbican.certfile = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] barbican.collect_timing = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] barbican.insecure = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] barbican.keyfile = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] barbican.number_of_retries = 60 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] barbican.retry_delay = 1 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] barbican.send_service_user_token = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] barbican.split_loggers = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] barbican.timeout = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] barbican.verify_ssl = True {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] barbican.verify_ssl_path = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] barbican_service_user.auth_section = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack quobyte-client[81578]: Reading configuration file: /etc/quobyte/client.cfg Apr 24 13:43:20 devstack quobyte-client[81578]: Invalid parameters found, error: missing mount point. Apr 24 13:43:20 devstack quobyte-client[81578]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 24 13:43:20 devstack quobyte-client[81578]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] barbican_service_user.auth_type = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] barbican_service_user.cafile = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] barbican_service_user.certfile = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] barbican_service_user.collect_timing = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] barbican_service_user.insecure = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] barbican_service_user.keyfile = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] barbican_service_user.split_loggers = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] barbican_service_user.timeout = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] vault.approle_role_id = **** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] vault.approle_secret_id = **** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] vault.kv_mountpoint = secret {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] vault.kv_path = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] vault.kv_version = 2 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] vault.namespace = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] vault.root_token_id = **** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] vault.ssl_ca_crt_file = None {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] vault.timeout = 60.0 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] vault.use_ssl = False {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:20 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] ******************************************************************************** {{(pid=81456) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 24 13:43:20 devstack cinder-volume[81575]: DEBUG oslo_concurrency.processutils [None req-f87e5059-a08e-4d5a-a2e8-c79a3d6df9bd None None] CMD "mount.quobyte" returned: 1 in 0.084s {{(pid=81575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:43:20 devstack cinder-volume[81575]: DEBUG oslo_concurrency.lockutils [None req-f87e5059-a08e-4d5a-a2e8-c79a3d6df9bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81575) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:43:20 devstack cinder-volume[81575]: DEBUG oslo_concurrency.lockutils [None req-f87e5059-a08e-4d5a-a2e8-c79a3d6df9bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81575) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:43:20 devstack cinder-volume[81575]: DEBUG cinder.volume.drivers.quobyte [None req-f87e5059-a08e-4d5a-a2e8-c79a3d6df9bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=81575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:43:20 devstack cinder-volume[81575]: INFO cinder.volume.drivers.quobyte [None req-f87e5059-a08e-4d5a-a2e8-c79a3d6df9bd None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 ... Apr 24 13:43:20 devstack cinder-volume[81575]: DEBUG oslo_concurrency.processutils [None req-f87e5059-a08e-4d5a-a2e8-c79a3d6df9bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b -c /etc/quobyte/client-cinder.cfg {{(pid=81575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:43:20 devstack sudo[81579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b -c /etc/quobyte/client-cinder.cfg Apr 24 13:43:20 devstack sudo[81579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:43:20 devstack sudo[81579]: pam_unix(sudo:session): session closed for user root Apr 24 13:43:20 devstack cinder-volume[81575]: DEBUG oslo_concurrency.processutils [None req-f87e5059-a08e-4d5a-a2e8-c79a3d6df9bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.598s {{(pid=81575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:43:20 devstack cinder-volume[81575]: INFO cinder.volume.drivers.quobyte [None req-f87e5059-a08e-4d5a-a2e8-c79a3d6df9bd None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 succeeded Apr 24 13:43:20 devstack cinder-volume[81575]: DEBUG cinder.volume.drivers.quobyte [None req-f87e5059-a08e-4d5a-a2e8-c79a3d6df9bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=81575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:43:20 devstack cinder-volume[81575]: DEBUG oslo_concurrency.lockutils [None req-f87e5059-a08e-4d5a-a2e8-c79a3d6df9bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.606s {{(pid=81575) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:43:20 devstack cinder-volume[81575]: DEBUG oslo_concurrency.processutils [None req-f87e5059-a08e-4d5a-a2e8-c79a3d6df9bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=81575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:43:20 devstack sudo[81648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:43:20 devstack sudo[81648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:43:21 devstack sudo[81648]: pam_unix(sudo:session): session closed for user root Apr 24 13:43:21 devstack cinder-volume[81575]: DEBUG oslo_concurrency.processutils [None req-f87e5059-a08e-4d5a-a2e8-c79a3d6df9bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.451s {{(pid=81575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:43:21 devstack cinder-volume[81575]: INFO cinder.volume.driver [None req-f87e5059-a08e-4d5a-a2e8-c79a3d6df9bd None None] Driver hasn't implemented _init_vendor_properties() Apr 24 13:43:21 devstack cinder-volume[81575]: DEBUG cinder.volume.driver [None req-f87e5059-a08e-4d5a-a2e8-c79a3d6df9bd None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6122970581055, 'free_capacity_gb': 1775.6122970581055, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81575) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 24 13:43:21 devstack cinder-volume[81575]: DEBUG oslo_db.sqlalchemy.engines [None req-f87e5059-a08e-4d5a-a2e8-c79a3d6df9bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81575) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 13:43:21 devstack cinder-volume[81575]: DEBUG dbcounter [-] [81575] Writer thread running {{(pid=81575) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 24 13:43:21 devstack cinder-volume[81575]: DEBUG cinder.db.sqlalchemy.api [None req-f87e5059-a08e-4d5a-a2e8-c79a3d6df9bd None None] Building query based on filter {{(pid=81575) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 24 13:43:21 devstack cinder-volume[81575]: DEBUG cinder.image.image_utils [None req-f87e5059-a08e-4d5a-a2e8-c79a3d6df9bd None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81575) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 24 13:43:21 devstack cinder-volume[81575]: INFO cinder.keymgr.migration [None req-76759370-e8e6-434f-a483-4b25adae3dd9 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 24 13:43:21 devstack cinder-volume[81575]: DEBUG oslo_concurrency.lockutils [None req-f87e5059-a08e-4d5a-a2e8-c79a3d6df9bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81575) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:43:21 devstack cinder-volume[81575]: DEBUG oslo_concurrency.lockutils [None req-f87e5059-a08e-4d5a-a2e8-c79a3d6df9bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81575) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:43:21 devstack cinder-volume[81575]: DEBUG cinder.volume.drivers.quobyte [None req-f87e5059-a08e-4d5a-a2e8-c79a3d6df9bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=81575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:43:21 devstack cinder-volume[81575]: DEBUG cinder.volume.drivers.quobyte [None req-f87e5059-a08e-4d5a-a2e8-c79a3d6df9bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=81575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:43:21 devstack cinder-volume[81575]: DEBUG oslo_concurrency.lockutils [None req-f87e5059-a08e-4d5a-a2e8-c79a3d6df9bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81575) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:43:21 devstack cinder-volume[81575]: DEBUG oslo_concurrency.processutils [None req-f87e5059-a08e-4d5a-a2e8-c79a3d6df9bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=81575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:43:21 devstack sudo[81651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:43:21 devstack sudo[81651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:43:21 devstack sudo[81651]: pam_unix(sudo:session): session closed for user root Apr 24 13:43:21 devstack cinder-volume[81575]: DEBUG oslo_concurrency.processutils [None req-f87e5059-a08e-4d5a-a2e8-c79a3d6df9bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.447s {{(pid=81575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:43:21 devstack cinder-volume[81575]: DEBUG cinder.manager [None req-f87e5059-a08e-4d5a-a2e8-c79a3d6df9bd None None] Notifying Schedulers of capabilities ... {{(pid=81575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:43:21 devstack cinder-volume[81575]: INFO cinder.volume.manager [None req-f87e5059-a08e-4d5a-a2e8-c79a3d6df9bd None None] Driver initialization completed successfully. Apr 24 13:43:21 devstack cinder-volume[81575]: INFO cinder.manager [None req-f87e5059-a08e-4d5a-a2e8-c79a3d6df9bd None None] Initiating service 3 cleanup Apr 24 13:43:21 devstack cinder-volume[81575]: INFO cinder.manager [None req-f87e5059-a08e-4d5a-a2e8-c79a3d6df9bd None None] Service 3 cleanup completed. Apr 24 13:43:21 devstack cinder-volume[81575]: DEBUG cinder.service [None req-f87e5059-a08e-4d5a-a2e8-c79a3d6df9bd None None] Creating RPC server for service cinder-volume {{(pid=81575) start /opt/stack/cinder/cinder/service.py:231}} Apr 24 13:43:21 devstack cinder-volume[81575]: DEBUG cinder.service [None req-f87e5059-a08e-4d5a-a2e8-c79a3d6df9bd None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81575) start /opt/stack/cinder/cinder/service.py:237}} Apr 24 13:43:22 devstack cinder-volume[81575]: INFO cinder.volume.manager [None req-f87e5059-a08e-4d5a-a2e8-c79a3d6df9bd None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 24 13:43:22 devstack cinder-volume[81575]: DEBUG oslo_concurrency.lockutils [None req-f87e5059-a08e-4d5a-a2e8-c79a3d6df9bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81575) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:43:22 devstack cinder-volume[81575]: DEBUG oslo_concurrency.lockutils [None req-f87e5059-a08e-4d5a-a2e8-c79a3d6df9bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81575) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:43:22 devstack cinder-volume[81575]: DEBUG cinder.volume.drivers.quobyte [None req-f87e5059-a08e-4d5a-a2e8-c79a3d6df9bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=81575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:43:22 devstack cinder-volume[81575]: DEBUG cinder.volume.drivers.quobyte [None req-f87e5059-a08e-4d5a-a2e8-c79a3d6df9bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=81575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:43:22 devstack cinder-volume[81575]: DEBUG oslo_concurrency.lockutils [None req-f87e5059-a08e-4d5a-a2e8-c79a3d6df9bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81575) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:43:22 devstack cinder-volume[81575]: DEBUG oslo_concurrency.processutils [None req-f87e5059-a08e-4d5a-a2e8-c79a3d6df9bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=81575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:43:22 devstack sudo[81657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:43:22 devstack sudo[81657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:43:22 devstack sudo[81657]: pam_unix(sudo:session): session closed for user root Apr 24 13:43:22 devstack cinder-volume[81575]: DEBUG oslo_concurrency.processutils [None req-f87e5059-a08e-4d5a-a2e8-c79a3d6df9bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.556s {{(pid=81575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:43:22 devstack cinder-volume[81575]: INFO cinder.volume.manager [None req-f87e5059-a08e-4d5a-a2e8-c79a3d6df9bd None None] Driver post RPC initialization completed successfully. Apr 24 13:43:25 devstack cinder-volume[81575]: DEBUG oslo_concurrency.lockutils [None req-e447258c-1762-4bbd-b1f2-4046536bd275 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81575) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:43:25 devstack cinder-volume[81575]: DEBUG oslo_concurrency.lockutils [None req-e447258c-1762-4bbd-b1f2-4046536bd275 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81575) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:43:25 devstack cinder-volume[81575]: DEBUG cinder.volume.drivers.quobyte [None req-e447258c-1762-4bbd-b1f2-4046536bd275 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=81575) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:43:25 devstack cinder-volume[81575]: DEBUG cinder.volume.drivers.quobyte [None req-e447258c-1762-4bbd-b1f2-4046536bd275 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=81575) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:43:25 devstack cinder-volume[81575]: DEBUG oslo_concurrency.lockutils [None req-e447258c-1762-4bbd-b1f2-4046536bd275 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81575) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:43:25 devstack cinder-volume[81575]: DEBUG oslo_concurrency.processutils [None req-e447258c-1762-4bbd-b1f2-4046536bd275 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=81575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:43:25 devstack sudo[81722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:43:25 devstack sudo[81722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:43:26 devstack sudo[81722]: pam_unix(sudo:session): session closed for user root Apr 24 13:43:26 devstack cinder-volume[81575]: DEBUG oslo_concurrency.processutils [None req-e447258c-1762-4bbd-b1f2-4046536bd275 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.430s {{(pid=81575) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:43:26 devstack cinder-volume[81575]: DEBUG cinder.manager [None req-e447258c-1762-4bbd-b1f2-4046536bd275 None None] Notifying Schedulers of capabilities ... {{(pid=81575) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:43:27 devstack cinder-volume[81456]: INFO oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] Caught SIGTERM, stopping children Apr 24 13:43:27 devstack cinder-volume[81456]: DEBUG oslo_concurrency.lockutils [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] Acquiring lock "singleton_lock" {{(pid=81456) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 13:43:27 devstack cinder-volume[81456]: DEBUG oslo_concurrency.lockutils [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] Acquired lock "singleton_lock" {{(pid=81456) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 13:43:27 devstack cinder-volume[81456]: DEBUG oslo_concurrency.lockutils [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] Releasing lock "singleton_lock" {{(pid=81456) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 13:43:27 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] Stop services. {{(pid=81456) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 24 13:43:27 devstack cinder-volume[81456]: DEBUG oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] Killing children. {{(pid=81456) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 24 13:43:27 devstack cinder-volume[81456]: INFO oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] Waiting on 1 children to exit Apr 24 13:43:30 devstack cinder-volume[81575]: DEBUG oslo_concurrency.lockutils [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] Acquiring lock "singleton_lock" {{(pid=81575) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 13:43:30 devstack cinder-volume[81575]: DEBUG oslo_concurrency.lockutils [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] Acquired lock "singleton_lock" {{(pid=81575) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 13:43:30 devstack cinder-volume[81575]: DEBUG oslo_concurrency.lockutils [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] Releasing lock "singleton_lock" {{(pid=81575) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 13:43:30 devstack cinder-volume[81575]: WARNING amqp [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 24 13:43:30 devstack cinder-volume[81575]: WARNING amqp [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 24 13:43:30 devstack cinder-volume[81456]: INFO oslo_service.backend._eventlet.service [None req-175e4d0f-5f9f-45b9-922f-01808004e322 None None] Child 81575 exited with status 0 Apr 24 13:43:30 devstack cinder-volume[81804]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 24 13:43:30 devstack cinder-volume[81804]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 24 13:43:30 devstack cinder-volume[81804]: we strongly recommend against using it for new projects. Apr 24 13:43:30 devstack cinder-volume[81804]: If you are already using Eventlet, we recommend migrating to a different Apr 24 13:43:30 devstack cinder-volume[81804]: framework. For more detail see Apr 24 13:43:30 devstack cinder-volume[81804]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 24 13:43:30 devstack cinder-volume[81804]: import eventlet # noqa Apr 24 13:43:32 devstack cinder-volume[81804]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81804) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 24 13:43:32 devstack cinder-volume[81804]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81804) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 24 13:43:32 devstack cinder-volume[81804]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81804) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 24 13:43:33 devstack cinder-volume[81804]: INFO dbcounter [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] Registered counter for database cinder Apr 24 13:43:33 devstack cinder-volume[81804]: DEBUG oslo_db.sqlalchemy.engines [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81804) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 13:43:33 devstack cinder-volume[81804]: DEBUG dbcounter [-] [81804] Writer thread running {{(pid=81804) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 24 13:43:33 devstack cinder-volume[81804]: INFO cinder.rpc [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 24 13:43:33 devstack cinder-volume[81804]: INFO cinder.rpc [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 24 13:43:33 devstack cinder-volume[81804]: DEBUG oslo_db.sqlalchemy.engines [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81804) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 13:43:34 devstack cinder-volume[81804]: INFO cinder.volume.manager [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] Determined volume DB was empty at startup. Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG cinder.volume.manager [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81804) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 24 13:43:34 devstack cinder-volume[81804]: WARNING stevedore.named [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 24 13:43:34 devstack cinder-volume[81804]: WARNING castellan.key_manager [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 13:43:34 devstack cinder-volume[81804]: WARNING cinder.keymgr.conf_key_mgr [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 24 13:43:34 devstack cinder-volume[81804]: INFO cinder.volume.manager [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_db.sqlalchemy.engines [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81804) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 13:43:34 devstack cinder-volume[81804]: INFO oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] Starting 1 workers Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] Started child 82046 {{(pid=81804) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] Full set of CONF: {{(pid=81804) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] ******************************************************************************** {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] Configuration options gathered from: {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] ================================================================================ {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] allow_availability_zone_fallback = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] allow_compression_on_image_upload = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] allowed_direct_url_schemes = [] {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] api_rate_limit = True {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] auth_strategy = keystone {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_availability_zone = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_host = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_name = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_stats_polling_interval = 60 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backup_api_class = cinder.backup.api.API {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backup_name_template = backup-%s {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backup_use_same_host = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backup_use_temp_snapshot = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] chap_password = **** {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] chap_username = {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] cinder_internal_tenant_project_id = bcc0e50377b249579df09011f3e1267b {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] cinder_internal_tenant_user_id = a27f3a18eca245a1b474ca506760fd74 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] cluster = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] compression_format = gzip {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] compute_api_class = cinder.compute.nova.API {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] config_dir = [] {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] config_source = [] {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] control_exchange = openstack {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] debug = True {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] default_availability_zone = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] default_group_type = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] default_volume_type = QuobyteHD {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] disk_geometry = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] driver_client_cert = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] driver_client_cert_key = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] driver_data_namespace = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] driver_ssl_cert_path = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] driver_ssl_cert_verify = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] driver_use_ssl = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] enable_new_services = True {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] enable_unsupported_driver = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] enabled_backends = ['QuobyteHD'] {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] enforce_multipath_for_image_xfer = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] filter_function = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] glance_api_insecure = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] glance_api_servers = ['http://192.168.122.171/image'] {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] glance_api_ssl_compression = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] glance_ca_certificates_file = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] glance_catalog_info = image:glance:publicURL {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] glance_certfile = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] glance_keyfile = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] glance_num_retries = 3 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] glance_request_timeout = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] goodness_function = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] graceful_shutdown_timeout = 5 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] group_api_class = cinder.group.api.API {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] host = devstack {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[82046]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] image_compress_on_upload = True {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] image_conversion_address_space_limit = 1 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] image_conversion_cpu_limit = 60 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] image_conversion_disable = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] image_upload_use_cinder_backend = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] image_upload_use_internal_tenant = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] image_volume_cache_enabled = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] image_volume_cache_max_count = 0 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] image_volume_cache_max_size_gb = 0 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] init_host_max_objects_retrieval = 0 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] instance_format = [instance: %(uuid)s] {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] iscsi_target_flags = {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] iscsi_write_cache = on {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] iser_helper = tgtadm {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] iser_ip_address = 192.168.122.171 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] iser_port = 3260 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] log_color = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] log_config_append = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] log_dir = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] log_file = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] log_options = True {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] log_rotate_interval = 1 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] log_rotate_interval_type = days {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] log_rotation_type = none {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] max_age = 0 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] max_logfile_count = 30 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] max_logfile_size_mb = 200 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] max_over_subscription_ratio = 20.0 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] message_reap_interval = 86400 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] message_ttl = 2592000 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] migration_create_volume_timeout_secs = 300 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] monkey_patch = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] monkey_patch_modules = [] {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] my_ip = 192.168.122.171 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] no_snapshot_gb_quota = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] num_iser_scan_tries = 3 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] num_shell_tries = 3 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] num_volume_device_scan_tries = 3 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] nvmeof_conn_info_version = 1 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] nvmet_ns_id = 10 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] nvmet_port_id = 1 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] osapi_max_limit = 1000 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] osapi_volume_ext_list = [] {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] osapi_volume_listen = 0.0.0.0 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] osapi_volume_listen_port = 8776 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] osapi_volume_use_ssl = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] osapi_volume_workers = 2 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] per_volume_size_limit = -1 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] periodic_fuzzy_delay = 60 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] periodic_interval = 60 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] project_id_regex = [0-9a-f\-]+ {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] public_endpoint = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] publish_errors = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] quota_backup_gigabytes = 1000 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] quota_backups = 10 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] quota_gigabytes = 1000 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] quota_groups = 10 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] quota_snapshots = 10 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] quota_volumes = 10 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] rate_limit_burst = 0 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] rate_limit_except_level = CRITICAL {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] rate_limit_interval = 0 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] reinit_driver_count = 3 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] replication_device = **** {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] report_discard_supported = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] report_interval = 120 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] reservation_clean_interval = 86400 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] reservation_expire = 86400 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] reserved_image_namespaces = [] {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] reserved_percentage = 0 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] rpc_response_timeout = 120 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] run_external_periodic_tasks = True {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] scst_target_driver = iscsi {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] scst_target_iqn_name = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] service_down_time = 720 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] shell_completion = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] snapshot_name_template = snapshot-%s {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] split_loggers = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] state_path = /opt/stack/data/cinder {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] storage_availability_zone = nova {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] storage_protocol = iSCSI {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] syslog_log_facility = LOG_USER {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] target_helper = lioadm {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] target_ip_address = 192.168.122.171 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] target_port = 3260 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] target_protocol = iscsi {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] target_secondary_ip_addresses = [] {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] trace_flags = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] transfer_api_class = cinder.transfer.api.API {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] transport_url = **** {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] until_refresh = 0 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] use_chap_auth = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] use_default_quota_class = True {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] use_journal = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] use_json = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] use_multipath_for_image_xfer = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] use_stderr = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] use_syslog = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] verify_glance_signatures = enabled {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] volume_api_class = cinder.volume.api.API {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] volume_backend_name = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] volume_clear = zero {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] volume_clear_ionice = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] volume_clear_size = 0 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] volume_copy_bps_limit = 0 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] volume_dd_blocksize = 1M {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] volume_name_template = volume-%s {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] volume_service_inithost_offload = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-0e0e3461-4b12-4017-97ee-0d85aad7e08d None None] Starting volume driver QuobyteDriver (1.1.14) Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] volume_usage_audit_period = month {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-0e0e3461-4b12-4017-97ee-0d85aad7e08d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82046) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] zoning_mode = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_concurrency.disable_process_locking = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] keystone_authtoken.admin_password = **** {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] keystone_authtoken.admin_token = **** {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] keystone_authtoken.admin_user = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] keystone_authtoken.auth_admin_prefix = {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] keystone_authtoken.auth_port = 35357 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] keystone_authtoken.auth_protocol = https {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] keystone_authtoken.auth_section = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] keystone_authtoken.auth_type = password {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] keystone_authtoken.auth_uri = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] keystone_authtoken.auth_version = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] keystone_authtoken.cache = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] keystone_authtoken.certfile = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] keystone_authtoken.delay_auth_decision = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] keystone_authtoken.http_connect_timeout = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] keystone_authtoken.identity_uri = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] keystone_authtoken.include_service_catalog = True {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] keystone_authtoken.insecure = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] keystone_authtoken.interface = public {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] keystone_authtoken.keyfile = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] keystone_authtoken.memcache_password = {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] keystone_authtoken.memcache_username = {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] keystone_authtoken.region_name = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] keystone_authtoken.service_token_roles_required = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] keystone_authtoken.service_type = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] keystone_authtoken.token_cache_time = 300 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.171/identity {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] cache.backend = dogpile.cache.null {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] cache.backend_argument = **** {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] cache.backend_expiration_time = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] cache.config_prefix = cache.oslo {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] cache.debug_cache_backend = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] cache.enable_retry_client = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] cache.enable_socket_keepalive = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] cache.enabled = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] cache.enforce_fips_mode = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] cache.expiration_time = 600 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] cache.hashclient_retry_attempts = 2 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] cache.memcache_dead_retry = 300 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] cache.memcache_pool_maxsize = 10 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] cache.memcache_sasl_enabled = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] cache.password = **** {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] cache.proxies = [] {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] cache.redis_db = 0 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] cache.redis_sentinel_service_name = mymaster {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] cache.redis_server = localhost:6379 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] cache.retry_attempts = 2 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] cache.retry_delay = 0.0 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] cache.socket_keepalive_count = 1 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] cache.socket_keepalive_idle = 1 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] cache.socket_keepalive_interval = 1 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] cache.socket_timeout = 1.0 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] cache.tls_allowed_ciphers = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] cache.tls_cafile = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] cache.tls_certfile = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] cache.tls_enabled = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] cache.tls_keyfile = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] cache.username = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] coordination.backend_url = **** {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] database.asyncio_connection = **** {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] database.asyncio_slave_connection = **** {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] database.backend = sqlalchemy {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] database.connection = **** {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] database.connection_debug = 0 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] database.connection_parameters = {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] database.connection_recycle_time = 3600 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] database.connection_trace = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] database.db_inc_retry_interval = True {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] database.db_max_retries = 20 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] database.db_max_retry_interval = 10 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] database.db_retry_interval = 1 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] database.max_overflow = 50 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] database.max_pool_size = 5 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] database.max_retries = 10 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] database.mysql_wsrep_sync_wait = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] database.pool_timeout = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] database.retry_interval = 10 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] database.slave_connection = **** {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] database.sqlite_synchronous = True {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] database.synchronous_reader = True {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] database.use_db_reconnect = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] profiler.connection_string = messaging:// {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] profiler.enabled = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] profiler.es_doc_type = notification {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] profiler.es_scroll_size = 10000 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] profiler.es_scroll_time = 2m {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] profiler.filter_error_trace = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] profiler.hmac_keys = **** {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] profiler.sentinel_service_name = mymaster {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] profiler.socket_timeout = 0.1 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] profiler.trace_requests = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] profiler.trace_sqlalchemy = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] profiler_jaeger.process_tags = {} {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] profiler_jaeger.service_name_prefix = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] profiler_otlp.service_name_prefix = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_policy.enforce_new_defaults = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: WARNING oslo_config.cfg [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_policy.enforce_scope = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_policy.policy_default_rule = default {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_policy.policy_file = policy.yaml {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_policy.remote_timeout = 60.0 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] privsep_osbrick.group = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] privsep_osbrick.helper_command = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] privsep_osbrick.user = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] cinder_sys_admin.group = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] cinder_sys_admin.helper_command = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] cinder_sys_admin.user = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] service_user.auth_section = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] service_user.auth_type = password {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] service_user.cafile = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] service_user.certfile = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] service_user.collect_timing = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] service_user.insecure = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] service_user.keyfile = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] service_user.send_service_user_token = True {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] service_user.split_loggers = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] service_user.timeout = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] glance.auth_section = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] glance.auth_type = password {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] glance.certfile = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] glance.collect_timing = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] glance.insecure = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] glance.keyfile = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] glance.region_name = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] glance.split_loggers = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] glance.timeout = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.backend_availability_zone = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.chap_password = **** {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.chap_username = {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.disk_geometry = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.driver_client_cert = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.driver_client_cert_key = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.driver_data_namespace = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.driver_use_ssl = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.enable_unsupported_driver = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.extra_capabilities = {} {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.filter_function = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.goodness_function = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.iscsi_target_flags = {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.iscsi_write_cache = on {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.iser_helper = tgtadm {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.iser_ip_address = 192.168.122.171 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.iser_port = 3260 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.nas_host = {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.nas_login = admin {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.nas_mount_options = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.nas_password = **** {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.nas_private_key = {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.nas_share_path = {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.nas_ssh_port = 22 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.num_shell_tries = 3 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.nvmet_port_id = 1 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.quobyte_client_cfg = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.quobyte_volume_url = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.replication_device = **** {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.report_discard_supported = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.reserved_percentage = 0 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.scst_target_driver = iscsi {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.scst_target_iqn_name = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.storage_protocol = iSCSI {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.target_helper = tgtadm {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.target_ip_address = 192.168.122.171 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.target_port = 3260 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.target_protocol = iscsi {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.trace_flags = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.unique_fqdn_network = True {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.use_chap_auth = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.volume_backend_name = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.volume_clear = zero {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.volume_clear_ionice = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.volume_clear_size = 0 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-0e0e3461-4b12-4017-97ee-0d85aad7e08d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82046) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.quobyte [None req-0e0e3461-4b12-4017-97ee-0d85aad7e08d None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.quobyte [None req-0e0e3461-4b12-4017-97ee-0d85aad7e08d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_reports.file_event_handler = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_reports.log_dir = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.backend_availability_zone = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.backend_host = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0e0e3461-4b12-4017-97ee-0d85aad7e08d None None] Running cmd (subprocess): mount.quobyte {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.chap_password = **** {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.chap_username = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.chiscsi_conf = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.disk_geometry = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.driver_client_cert = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.driver_client_cert_key = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.driver_data_namespace = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.driver_use_ssl = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.extra_capabilities = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.filter_function = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.goodness_function = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.iscsi_target_flags = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.iscsi_write_cache = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.iser_helper = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.iser_ip_address = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.iser_port = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.iser_target_prefix = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.nas_host = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.nas_login = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.nas_mount_options = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.nas_password = **** {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.nas_private_key = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.nas_share_path = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.nas_ssh_port = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.num_shell_tries = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.nvmet_ns_id = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.nvmet_port_id = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.replication_device = **** {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.report_discard_supported = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.reserved_percentage = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.scst_target_driver = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.storage_protocol = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.target_helper = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.target_ip_address = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.target_port = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.target_prefix = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.target_protocol = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.trace_flags = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.unique_fqdn_network = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.use_chap_auth = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.volume_clear = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.volume_clear_ionice = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.volume_clear_size = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] QuobyteHD.volumes_dir = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_messaging_rabbit.ssl = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_messaging_rabbit.ssl_version = {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_messaging_notifications.driver = [] {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_messaging_notifications.retry = -1 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] oslo_messaging_notifications.transport_url = **** {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] key_manager.fixed_key = **** {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] barbican.barbican_api_version = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] barbican.barbican_endpoint = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] barbican.barbican_endpoint_type = public {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] barbican.barbican_region_name = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] barbican.cafile = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] barbican.certfile = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] barbican.collect_timing = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] barbican.insecure = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] barbican.keyfile = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] barbican.number_of_retries = 60 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] barbican.retry_delay = 1 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] barbican.send_service_user_token = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] barbican.split_loggers = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] barbican.timeout = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] barbican.verify_ssl = True {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] barbican.verify_ssl_path = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack sudo[82063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] barbican_service_user.auth_section = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] barbican_service_user.auth_type = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] barbican_service_user.cafile = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] barbican_service_user.certfile = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] barbican_service_user.collect_timing = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] barbican_service_user.insecure = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] barbican_service_user.keyfile = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack sudo[82063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] barbican_service_user.split_loggers = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] barbican_service_user.timeout = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] vault.approle_role_id = **** {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] vault.approle_secret_id = **** {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] vault.kv_mountpoint = secret {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] vault.kv_path = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] vault.kv_version = 2 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] vault.namespace = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] vault.root_token_id = **** {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] vault.ssl_ca_crt_file = None {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] vault.timeout = 60.0 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] vault.use_ssl = False {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 24 13:43:34 devstack cinder-volume[81804]: DEBUG oslo_service.backend._eventlet.service [None req-1d957b52-42bc-4d3f-9d74-75ab4f1ce83f None None] ******************************************************************************** {{(pid=81804) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 24 13:43:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0e0e3461-4b12-4017-97ee-0d85aad7e08d None None] CMD "mount.quobyte" returned: 1 in 0.055s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:43:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0e0e3461-4b12-4017-97ee-0d85aad7e08d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:43:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0e0e3461-4b12-4017-97ee-0d85aad7e08d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:43:34 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-0e0e3461-4b12-4017-97ee-0d85aad7e08d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:43:34 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-0e0e3461-4b12-4017-97ee-0d85aad7e08d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:43:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0e0e3461-4b12-4017-97ee-0d85aad7e08d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:43:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0e0e3461-4b12-4017-97ee-0d85aad7e08d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:43:34 devstack sudo[82063]: pam_unix(sudo:session): session closed for user root Apr 24 13:43:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0e0e3461-4b12-4017-97ee-0d85aad7e08d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.448s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:43:34 devstack cinder-volume[82046]: INFO cinder.volume.driver [None req-0e0e3461-4b12-4017-97ee-0d85aad7e08d None None] Driver hasn't implemented _init_vendor_properties() Apr 24 13:43:34 devstack cinder-volume[82046]: DEBUG cinder.volume.driver [None req-0e0e3461-4b12-4017-97ee-0d85aad7e08d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5848770141602, 'free_capacity_gb': 1775.5848770141602, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82046) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 24 13:43:34 devstack cinder-volume[82046]: DEBUG oslo_db.sqlalchemy.engines [None req-0e0e3461-4b12-4017-97ee-0d85aad7e08d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82046) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 24 13:43:34 devstack cinder-volume[82046]: DEBUG dbcounter [-] [82046] Writer thread running {{(pid=82046) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 24 13:43:34 devstack cinder-volume[82046]: DEBUG cinder.db.sqlalchemy.api [None req-0e0e3461-4b12-4017-97ee-0d85aad7e08d None None] Building query based on filter {{(pid=82046) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 24 13:43:34 devstack cinder-volume[82046]: DEBUG cinder.image.image_utils [None req-0e0e3461-4b12-4017-97ee-0d85aad7e08d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82046) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 24 13:43:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0e0e3461-4b12-4017-97ee-0d85aad7e08d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:43:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0e0e3461-4b12-4017-97ee-0d85aad7e08d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:43:34 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-0e0e3461-4b12-4017-97ee-0d85aad7e08d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:43:34 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-0e0e3461-4b12-4017-97ee-0d85aad7e08d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:43:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0e0e3461-4b12-4017-97ee-0d85aad7e08d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:43:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0e0e3461-4b12-4017-97ee-0d85aad7e08d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:43:34 devstack cinder-volume[82046]: INFO cinder.keymgr.migration [None req-84d41d2d-464a-47fa-be92-4f44c73b23de None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 24 13:43:34 devstack sudo[82079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:43:34 devstack sudo[82079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:43:35 devstack sudo[82079]: pam_unix(sudo:session): session closed for user root Apr 24 13:43:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0e0e3461-4b12-4017-97ee-0d85aad7e08d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.476s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:43:35 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-0e0e3461-4b12-4017-97ee-0d85aad7e08d None None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:43:35 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-0e0e3461-4b12-4017-97ee-0d85aad7e08d None None] Driver initialization completed successfully. Apr 24 13:43:35 devstack cinder-volume[82046]: INFO cinder.manager [None req-0e0e3461-4b12-4017-97ee-0d85aad7e08d None None] Initiating service 3 cleanup Apr 24 13:43:35 devstack cinder-volume[82046]: INFO cinder.manager [None req-0e0e3461-4b12-4017-97ee-0d85aad7e08d None None] Service 3 cleanup completed. Apr 24 13:43:35 devstack cinder-volume[82046]: DEBUG cinder.service [None req-0e0e3461-4b12-4017-97ee-0d85aad7e08d None None] Creating RPC server for service cinder-volume {{(pid=82046) start /opt/stack/cinder/cinder/service.py:231}} Apr 24 13:43:35 devstack cinder-volume[82046]: DEBUG cinder.service [None req-0e0e3461-4b12-4017-97ee-0d85aad7e08d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82046) start /opt/stack/cinder/cinder/service.py:237}} Apr 24 13:43:35 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-0e0e3461-4b12-4017-97ee-0d85aad7e08d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 24 13:43:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0e0e3461-4b12-4017-97ee-0d85aad7e08d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:43:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0e0e3461-4b12-4017-97ee-0d85aad7e08d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:43:35 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-0e0e3461-4b12-4017-97ee-0d85aad7e08d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:43:35 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-0e0e3461-4b12-4017-97ee-0d85aad7e08d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:43:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0e0e3461-4b12-4017-97ee-0d85aad7e08d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:43:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0e0e3461-4b12-4017-97ee-0d85aad7e08d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:43:35 devstack sudo[82084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:43:35 devstack sudo[82084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:43:35 devstack sudo[82084]: pam_unix(sudo:session): session closed for user root Apr 24 13:43:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0e0e3461-4b12-4017-97ee-0d85aad7e08d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.452s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:43:35 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-0e0e3461-4b12-4017-97ee-0d85aad7e08d None None] Driver post RPC initialization completed successfully. Apr 24 13:43:44 devstack cinder-volume[81804]: DEBUG dbcounter [-] [81804] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=81804) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 13:43:45 devstack cinder-volume[82046]: DEBUG dbcounter [-] [82046] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=82046) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 13:43:45 devstack cinder-volume[82046]: DEBUG dbcounter [-] [82046] Writing DB stats cinder:SELECT=3 {{(pid=82046) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 13:44:32 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [req-0e8fca07-1b5a-44ea-bc0b-fddebb5aed91 req-1556a8b6-fb19-47c7-b139-915a2cc1a05a tempest-VolumesSnapshotsTestJSON-762351040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:44:32 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-0e8fca07-1b5a-44ea-bc0b-fddebb5aed91 req-1556a8b6-fb19-47c7-b139-915a2cc1a05a tempest-VolumesSnapshotsTestJSON-762351040 None] Flow 'volume_create_manager' (c1f0f3cd-4354-47a2-b47d-1384a93230e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:44:32 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-0e8fca07-1b5a-44ea-bc0b-fddebb5aed91 req-1556a8b6-fb19-47c7-b139-915a2cc1a05a tempest-VolumesSnapshotsTestJSON-762351040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (295bf290-9abd-4267-8863-02dd7aff2777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:44:32 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-0e8fca07-1b5a-44ea-bc0b-fddebb5aed91 req-1556a8b6-fb19-47c7-b139-915a2cc1a05a tempest-VolumesSnapshotsTestJSON-762351040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (295bf290-9abd-4267-8863-02dd7aff2777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1348819883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7e312d0-2854-4c49-b9d6-e4cfae395ad8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7601070ad4404c9db1730eb053c38de3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:44:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:44:32Z,use_quota=True,user_id='0128e2e6336a44638231734242a49a87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:44:32 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-0e8fca07-1b5a-44ea-bc0b-fddebb5aed91 req-1556a8b6-fb19-47c7-b139-915a2cc1a05a tempest-VolumesSnapshotsTestJSON-762351040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4abd2fd0-9e8c-4bd7-9625-e227260c5463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:44:32 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-0e8fca07-1b5a-44ea-bc0b-fddebb5aed91 req-1556a8b6-fb19-47c7-b139-915a2cc1a05a tempest-VolumesSnapshotsTestJSON-762351040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4abd2fd0-9e8c-4bd7-9625-e227260c5463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:44:32 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-0e8fca07-1b5a-44ea-bc0b-fddebb5aed91 req-1556a8b6-fb19-47c7-b139-915a2cc1a05a tempest-VolumesSnapshotsTestJSON-762351040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3a60b0f-7359-4ac1-baf3-123ba04b82b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:44:32 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-0e8fca07-1b5a-44ea-bc0b-fddebb5aed91 req-1556a8b6-fb19-47c7-b139-915a2cc1a05a tempest-VolumesSnapshotsTestJSON-762351040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3a60b0f-7359-4ac1-baf3-123ba04b82b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7e312d0-2854-4c49-b9d6-e4cfae395ad8', 'volume_name': 'volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:44:32 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-0e8fca07-1b5a-44ea-bc0b-fddebb5aed91 req-1556a8b6-fb19-47c7-b139-915a2cc1a05a tempest-VolumesSnapshotsTestJSON-762351040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e1a378a-47f5-4161-8c0a-aca32fe40cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:44:32 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-0e8fca07-1b5a-44ea-bc0b-fddebb5aed91 req-1556a8b6-fb19-47c7-b139-915a2cc1a05a tempest-VolumesSnapshotsTestJSON-762351040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e1a378a-47f5-4161-8c0a-aca32fe40cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:44:32 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-0e8fca07-1b5a-44ea-bc0b-fddebb5aed91 req-1556a8b6-fb19-47c7-b139-915a2cc1a05a tempest-VolumesSnapshotsTestJSON-762351040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7722ba58-1089-45b2-9b34-010362852b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:44:32 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [req-0e8fca07-1b5a-44ea-bc0b-fddebb5aed91 req-1556a8b6-fb19-47c7-b139-915a2cc1a05a tempest-VolumesSnapshotsTestJSON-762351040 None] Volume e7e312d0-2854-4c49-b9d6-e4cfae395ad8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8', 'volume_size': 1} Apr 24 13:44:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [req-0e8fca07-1b5a-44ea-bc0b-fddebb5aed91 req-1556a8b6-fb19-47c7-b139-915a2cc1a05a tempest-VolumesSnapshotsTestJSON-762351040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:44:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [req-0e8fca07-1b5a-44ea-bc0b-fddebb5aed91 req-1556a8b6-fb19-47c7-b139-915a2cc1a05a tempest-VolumesSnapshotsTestJSON-762351040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:44:32 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [req-0e8fca07-1b5a-44ea-bc0b-fddebb5aed91 req-1556a8b6-fb19-47c7-b139-915a2cc1a05a tempest-VolumesSnapshotsTestJSON-762351040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1348819883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7e312d0-2854-4c49-b9d6-e4cfae395ad8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7601070ad4404c9db1730eb053c38de3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:44:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:44:32Z,use_quota=True,user_id='0128e2e6336a44638231734242a49a87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:44:32 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [req-0e8fca07-1b5a-44ea-bc0b-fddebb5aed91 req-1556a8b6-fb19-47c7-b139-915a2cc1a05a tempest-VolumesSnapshotsTestJSON-762351040 None] Creating volume e7e312d0-2854-4c49-b9d6-e4cfae395ad8 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:44:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [req-0e8fca07-1b5a-44ea-bc0b-fddebb5aed91 req-1556a8b6-fb19-47c7-b139-915a2cc1a05a tempest-VolumesSnapshotsTestJSON-762351040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:44:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [req-0e8fca07-1b5a-44ea-bc0b-fddebb5aed91 req-1556a8b6-fb19-47c7-b139-915a2cc1a05a tempest-VolumesSnapshotsTestJSON-762351040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:44:32 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [req-0e8fca07-1b5a-44ea-bc0b-fddebb5aed91 req-1556a8b6-fb19-47c7-b139-915a2cc1a05a tempest-VolumesSnapshotsTestJSON-762351040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:44:32 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [req-0e8fca07-1b5a-44ea-bc0b-fddebb5aed91 req-1556a8b6-fb19-47c7-b139-915a2cc1a05a tempest-VolumesSnapshotsTestJSON-762351040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:44:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [req-0e8fca07-1b5a-44ea-bc0b-fddebb5aed91 req-1556a8b6-fb19-47c7-b139-915a2cc1a05a tempest-VolumesSnapshotsTestJSON-762351040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:44:32 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [req-0e8fca07-1b5a-44ea-bc0b-fddebb5aed91 req-1556a8b6-fb19-47c7-b139-915a2cc1a05a tempest-VolumesSnapshotsTestJSON-762351040 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:44:32 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [req-0e8fca07-1b5a-44ea-bc0b-fddebb5aed91 req-1556a8b6-fb19-47c7-b139-915a2cc1a05a tempest-VolumesSnapshotsTestJSON-762351040 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:44:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-0e8fca07-1b5a-44ea-bc0b-fddebb5aed91 req-1556a8b6-fb19-47c7-b139-915a2cc1a05a tempest-VolumesSnapshotsTestJSON-762351040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:44:32 devstack sudo[82359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8 1073741824 Apr 24 13:44:32 devstack sudo[82359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:44:33 devstack sudo[82359]: pam_unix(sudo:session): session closed for user root Apr 24 13:44:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-0e8fca07-1b5a-44ea-bc0b-fddebb5aed91 req-1556a8b6-fb19-47c7-b139-915a2cc1a05a tempest-VolumesSnapshotsTestJSON-762351040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8 1073741824" returned: 0 in 0.932s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:44:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-0e8fca07-1b5a-44ea-bc0b-fddebb5aed91 req-1556a8b6-fb19-47c7-b139-915a2cc1a05a tempest-VolumesSnapshotsTestJSON-762351040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:44:33 devstack sudo[82678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8 Apr 24 13:44:33 devstack sudo[82678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:44:34 devstack sudo[82678]: pam_unix(sudo:session): session closed for user root Apr 24 13:44:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-0e8fca07-1b5a-44ea-bc0b-fddebb5aed91 req-1556a8b6-fb19-47c7-b139-915a2cc1a05a tempest-VolumesSnapshotsTestJSON-762351040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8" returned: 0 in 0.705s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:44:34 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [req-0e8fca07-1b5a-44ea-bc0b-fddebb5aed91 req-1556a8b6-fb19-47c7-b139-915a2cc1a05a tempest-VolumesSnapshotsTestJSON-762351040 None] <== create_volume: return (1694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:44:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [req-0e8fca07-1b5a-44ea-bc0b-fddebb5aed91 req-1556a8b6-fb19-47c7-b139-915a2cc1a05a tempest-VolumesSnapshotsTestJSON-762351040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.696s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:44:34 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-0e8fca07-1b5a-44ea-bc0b-fddebb5aed91 req-1556a8b6-fb19-47c7-b139-915a2cc1a05a tempest-VolumesSnapshotsTestJSON-762351040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7722ba58-1089-45b2-9b34-010362852b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:44:34 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-0e8fca07-1b5a-44ea-bc0b-fddebb5aed91 req-1556a8b6-fb19-47c7-b139-915a2cc1a05a tempest-VolumesSnapshotsTestJSON-762351040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c0d8dfd-7824-4fb7-ba54-6d56903ffcc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:44:34 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [req-0e8fca07-1b5a-44ea-bc0b-fddebb5aed91 req-1556a8b6-fb19-47c7-b139-915a2cc1a05a tempest-VolumesSnapshotsTestJSON-762351040 None] Volume volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8 (e7e312d0-2854-4c49-b9d6-e4cfae395ad8): created successfully Apr 24 13:44:34 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-0e8fca07-1b5a-44ea-bc0b-fddebb5aed91 req-1556a8b6-fb19-47c7-b139-915a2cc1a05a tempest-VolumesSnapshotsTestJSON-762351040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c0d8dfd-7824-4fb7-ba54-6d56903ffcc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:44:34 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-0e8fca07-1b5a-44ea-bc0b-fddebb5aed91 req-1556a8b6-fb19-47c7-b139-915a2cc1a05a tempest-VolumesSnapshotsTestJSON-762351040 None] Flow 'volume_create_manager' (c1f0f3cd-4354-47a2-b47d-1384a93230e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:44:34 devstack cinder-volume[82046]: INFO cinder.volume.manager [req-0e8fca07-1b5a-44ea-bc0b-fddebb5aed91 req-1556a8b6-fb19-47c7-b139-915a2cc1a05a tempest-VolumesSnapshotsTestJSON-762351040 None] Created volume successfully. Apr 24 13:44:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [req-15e92e04-d9db-4a02-9007-21aaae4d07c2 req-f647f914-05ef-45b1-b534-f6233ec23e16 tempest-VolumesSnapshotsTestJSON-762351040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:44:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [req-15e92e04-d9db-4a02-9007-21aaae4d07c2 req-f647f914-05ef-45b1-b534-f6233ec23e16 tempest-VolumesSnapshotsTestJSON-762351040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.008s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:44:36 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [req-15e92e04-d9db-4a02-9007-21aaae4d07c2 req-f647f914-05ef-45b1-b534-f6233ec23e16 tempest-VolumesSnapshotsTestJSON-762351040 None] Creating offline snapshot fc007886-2a0f-4fb0-9e31-4eb26272a56e of volume e7e312d0-2854-4c49-b9d6-e4cfae395ad8 {{(pid=82046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 13:44:36 devstack cinder-volume[82046]: INFO oslo.privsep.daemon [req-15e92e04-d9db-4a02-9007-21aaae4d07c2 req-f647f914-05ef-45b1-b534-f6233ec23e16 tempest-VolumesSnapshotsTestJSON-762351040 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp0iho4uyb/privsep.sock'] Apr 24 13:44:36 devstack sudo[82696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp0iho4uyb/privsep.sock Apr 24 13:44:36 devstack sudo[82696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:44:37 devstack cinder-volume[82046]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 24 13:44:37 devstack cinder-volume[82046]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 24 13:44:37 devstack cinder-volume[82046]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 24 13:44:37 devstack cinder-volume[82046]: WARNING oslo.privsep.daemon [-] privsep log: Apr 24 13:44:37 devstack cinder-volume[82046]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 24 13:44:37 devstack cinder-volume[82046]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 24 13:44:37 devstack cinder-volume[82046]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 24 13:44:37 devstack cinder-volume[82046]: WARNING oslo.privsep.daemon [-] privsep log: Apr 24 13:44:37 devstack cinder-volume[82046]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 24 13:44:37 devstack cinder-volume[82046]: DEBUG oslo_service.periodic_task [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82046) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 13:44:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:44:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:44:37 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:44:37 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:44:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:44:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:44:37 devstack sudo[82715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:44:37 devstack sudo[82715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:44:38 devstack cinder-volume[82046]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 24 13:44:38 devstack cinder-volume[82046]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 24 13:44:38 devstack cinder-volume[82046]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 24 13:44:38 devstack cinder-volume[82046]: WARNING oslo.privsep.daemon [-] privsep log: Apr 24 13:44:38 devstack cinder-volume[82046]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 24 13:44:38 devstack cinder-volume[82046]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 24 13:44:38 devstack cinder-volume[82046]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 24 13:44:38 devstack cinder-volume[82046]: WARNING oslo.privsep.daemon [-] privsep log: Apr 24 13:44:38 devstack cinder-volume[82046]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 24 13:44:39 devstack sudo[82715]: pam_unix(sudo:session): session closed for user root Apr 24 13:44:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 1.167s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:44:39 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:44:39 devstack sudo[82696]: pam_unix(sudo:session): session closed for user root Apr 24 13:44:39 devstack cinder-volume[82046]: INFO oslo.privsep.daemon [req-15e92e04-d9db-4a02-9007-21aaae4d07c2 req-f647f914-05ef-45b1-b534-f6233ec23e16 tempest-VolumesSnapshotsTestJSON-762351040 None] Spawned new privsep daemon via rootwrap Apr 24 13:44:39 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [req-15e92e04-d9db-4a02-9007-21aaae4d07c2 req-f647f914-05ef-45b1-b534-f6233ec23e16 tempest-VolumesSnapshotsTestJSON-762351040 None] Accepted privsep connection to /tmp/tmp0iho4uyb/privsep.sock {{(pid=82046) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 24 13:44:39 devstack cinder-volume[82046]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 24 13:44:39 devstack cinder-volume[82046]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 24 13:44:39 devstack cinder-volume[82046]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 24 13:44:39 devstack cinder-volume[82046]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82735 Apr 24 13:44:39 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[e791f2b5-d424-4762-b7f4-9914df682119]: (2,) {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:44:39 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52190bd-9207-4099-ba22-2f7000761eda]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:44:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-15e92e04-d9db-4a02-9007-21aaae4d07c2 req-f647f914-05ef-45b1-b534-f6233ec23e16 tempest-VolumesSnapshotsTestJSON-762351040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:44:39 devstack sudo[82744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8 Apr 24 13:44:39 devstack sudo[82744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:44:40 devstack sudo[82744]: pam_unix(sudo:session): session closed for user root Apr 24 13:44:40 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-15e92e04-d9db-4a02-9007-21aaae4d07c2 req-f647f914-05ef-45b1-b534-f6233ec23e16 tempest-VolumesSnapshotsTestJSON-762351040 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8" returned: 0 in 1.047s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:44:40 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-15e92e04-d9db-4a02-9007-21aaae4d07c2 req-f647f914-05ef-45b1-b534-f6233ec23e16 tempest-VolumesSnapshotsTestJSON-762351040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8.fc007886-2a0f-4fb0-9e31-4eb26272a56e 1G {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:44:40 devstack sudo[82755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8.fc007886-2a0f-4fb0-9e31-4eb26272a56e 1G Apr 24 13:44:40 devstack sudo[82755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:44:41 devstack sudo[82755]: pam_unix(sudo:session): session closed for user root Apr 24 13:44:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-15e92e04-d9db-4a02-9007-21aaae4d07c2 req-f647f914-05ef-45b1-b534-f6233ec23e16 tempest-VolumesSnapshotsTestJSON-762351040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8.fc007886-2a0f-4fb0-9e31-4eb26272a56e 1G" returned: 0 in 1.117s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:44:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-15e92e04-d9db-4a02-9007-21aaae4d07c2 req-f647f914-05ef-45b1-b534-f6233ec23e16 tempest-VolumesSnapshotsTestJSON-762351040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8.fc007886-2a0f-4fb0-9e31-4eb26272a56e {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:44:41 devstack sudo[82764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8.fc007886-2a0f-4fb0-9e31-4eb26272a56e Apr 24 13:44:41 devstack sudo[82764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:44:42 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-16d7b475-e77b-4e6d-af6e-77dfd05a4b91 tempest-DeleteServersTestJSON-259405003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:44:42 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-16d7b475-e77b-4e6d-af6e-77dfd05a4b91 tempest-DeleteServersTestJSON-259405003 None] Flow 'volume_create_manager' (5a16c865-afa7-46ef-9450-53a95aa27da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:44:42 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-16d7b475-e77b-4e6d-af6e-77dfd05a4b91 tempest-DeleteServersTestJSON-259405003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2e3ea89-a106-49a3-9e79-3a1aa901cfb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:44:42 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-16d7b475-e77b-4e6d-af6e-77dfd05a4b91 tempest-DeleteServersTestJSON-259405003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2e3ea89-a106-49a3-9e79-3a1aa901cfb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:44:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-224222107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b77d1676-813c-489f-85e9-17d24105bbf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0123c5cfe1d94af09cb9a92dd33f6117',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:44:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:44:42Z,use_quota=True,user_id='5a2689c08f114d5897791aa7003dfca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:44:42 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-16d7b475-e77b-4e6d-af6e-77dfd05a4b91 tempest-DeleteServersTestJSON-259405003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (460f4aa0-7f78-45cc-9f53-15b94d89b066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:44:42 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-16d7b475-e77b-4e6d-af6e-77dfd05a4b91 tempest-DeleteServersTestJSON-259405003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (460f4aa0-7f78-45cc-9f53-15b94d89b066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:44:42 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-16d7b475-e77b-4e6d-af6e-77dfd05a4b91 tempest-DeleteServersTestJSON-259405003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b72e0691-53fc-413d-bb2f-7ca05ba894c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:44:42 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-16d7b475-e77b-4e6d-af6e-77dfd05a4b91 tempest-DeleteServersTestJSON-259405003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b72e0691-53fc-413d-bb2f-7ca05ba894c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b77d1676-813c-489f-85e9-17d24105bbf9', 'volume_name': 'volume-b77d1676-813c-489f-85e9-17d24105bbf9', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:44:42 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-16d7b475-e77b-4e6d-af6e-77dfd05a4b91 tempest-DeleteServersTestJSON-259405003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aac16ad-8140-4447-90a9-d68aa516e45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:44:42 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-16d7b475-e77b-4e6d-af6e-77dfd05a4b91 tempest-DeleteServersTestJSON-259405003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aac16ad-8140-4447-90a9-d68aa516e45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:44:42 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-16d7b475-e77b-4e6d-af6e-77dfd05a4b91 tempest-DeleteServersTestJSON-259405003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1388dfd1-52a0-4ba7-aad6-91d9672dd32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:44:42 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-16d7b475-e77b-4e6d-af6e-77dfd05a4b91 tempest-DeleteServersTestJSON-259405003 None] Volume b77d1676-813c-489f-85e9-17d24105bbf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b77d1676-813c-489f-85e9-17d24105bbf9', 'volume_size': 1} Apr 24 13:44:42 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-16d7b475-e77b-4e6d-af6e-77dfd05a4b91 tempest-DeleteServersTestJSON-259405003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:44:42 devstack sudo[82764]: pam_unix(sudo:session): session closed for user root Apr 24 13:44:42 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-15e92e04-d9db-4a02-9007-21aaae4d07c2 req-f647f914-05ef-45b1-b534-f6233ec23e16 tempest-VolumesSnapshotsTestJSON-762351040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8.fc007886-2a0f-4fb0-9e31-4eb26272a56e" returned: 0 in 0.918s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:44:42 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [req-15e92e04-d9db-4a02-9007-21aaae4d07c2 req-f647f914-05ef-45b1-b534-f6233ec23e16 tempest-VolumesSnapshotsTestJSON-762351040 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8.fc007886-2a0f-4fb0-9e31-4eb26272a56e is being set with open permissions: ugo+rw Apr 24 13:44:42 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-15e92e04-d9db-4a02-9007-21aaae4d07c2 req-f647f914-05ef-45b1-b534-f6233ec23e16 tempest-VolumesSnapshotsTestJSON-762351040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8.fc007886-2a0f-4fb0-9e31-4eb26272a56e {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:44:42 devstack sudo[82772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8.fc007886-2a0f-4fb0-9e31-4eb26272a56e Apr 24 13:44:42 devstack sudo[82772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:44:43 devstack sudo[82772]: pam_unix(sudo:session): session closed for user root Apr 24 13:44:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-15e92e04-d9db-4a02-9007-21aaae4d07c2 req-f647f914-05ef-45b1-b534-f6233ec23e16 tempest-VolumesSnapshotsTestJSON-762351040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8.fc007886-2a0f-4fb0-9e31-4eb26272a56e" returned: 0 in 0.699s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:44:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-15e92e04-d9db-4a02-9007-21aaae4d07c2 req-f647f914-05ef-45b1-b534-f6233ec23e16 tempest-VolumesSnapshotsTestJSON-762351040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:44:43 devstack sudo[82776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8.info Apr 24 13:44:43 devstack sudo[82776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:44:43 devstack sudo[82776]: pam_unix(sudo:session): session closed for user root Apr 24 13:44:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-15e92e04-d9db-4a02-9007-21aaae4d07c2 req-f647f914-05ef-45b1-b534-f6233ec23e16 tempest-VolumesSnapshotsTestJSON-762351040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8.info" returned: 0 in 0.515s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:44:43 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [req-15e92e04-d9db-4a02-9007-21aaae4d07c2 req-f647f914-05ef-45b1-b534-f6233ec23e16 tempest-VolumesSnapshotsTestJSON-762351040 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8.info is being set with open permissions: ugo+rw Apr 24 13:44:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-15e92e04-d9db-4a02-9007-21aaae4d07c2 req-f647f914-05ef-45b1-b534-f6233ec23e16 tempest-VolumesSnapshotsTestJSON-762351040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:44:44 devstack sudo[82781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8.info Apr 24 13:44:44 devstack sudo[82781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:44:44 devstack sudo[82781]: pam_unix(sudo:session): session closed for user root Apr 24 13:44:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-15e92e04-d9db-4a02-9007-21aaae4d07c2 req-f647f914-05ef-45b1-b534-f6233ec23e16 tempest-VolumesSnapshotsTestJSON-762351040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8.info" returned: 0 in 0.873s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:44:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [req-15e92e04-d9db-4a02-9007-21aaae4d07c2 req-f647f914-05ef-45b1-b534-f6233ec23e16 tempest-VolumesSnapshotsTestJSON-762351040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.157s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:44:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-16d7b475-e77b-4e6d-af6e-77dfd05a4b91 tempest-DeleteServersTestJSON-259405003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.510s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:44:44 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-16d7b475-e77b-4e6d-af6e-77dfd05a4b91 tempest-DeleteServersTestJSON-259405003 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:44:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-224222107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b77d1676-813c-489f-85e9-17d24105bbf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0123c5cfe1d94af09cb9a92dd33f6117',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:44:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:44:42Z,use_quota=True,user_id='5a2689c08f114d5897791aa7003dfca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:44:44 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-16d7b475-e77b-4e6d-af6e-77dfd05a4b91 tempest-DeleteServersTestJSON-259405003 None] Creating volume b77d1676-813c-489f-85e9-17d24105bbf9 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:44:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-16d7b475-e77b-4e6d-af6e-77dfd05a4b91 tempest-DeleteServersTestJSON-259405003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:44:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-16d7b475-e77b-4e6d-af6e-77dfd05a4b91 tempest-DeleteServersTestJSON-259405003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:44:44 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-16d7b475-e77b-4e6d-af6e-77dfd05a4b91 tempest-DeleteServersTestJSON-259405003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:44:44 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-16d7b475-e77b-4e6d-af6e-77dfd05a4b91 tempest-DeleteServersTestJSON-259405003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:44:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-16d7b475-e77b-4e6d-af6e-77dfd05a4b91 tempest-DeleteServersTestJSON-259405003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:44:44 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-16d7b475-e77b-4e6d-af6e-77dfd05a4b91 tempest-DeleteServersTestJSON-259405003 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:44:44 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-16d7b475-e77b-4e6d-af6e-77dfd05a4b91 tempest-DeleteServersTestJSON-259405003 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:44:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-16d7b475-e77b-4e6d-af6e-77dfd05a4b91 tempest-DeleteServersTestJSON-259405003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b77d1676-813c-489f-85e9-17d24105bbf9 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:44:44 devstack sudo[82786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b77d1676-813c-489f-85e9-17d24105bbf9 1073741824 Apr 24 13:44:44 devstack sudo[82786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:44:45 devstack cinder-volume[82046]: INFO cinder.volume.manager [req-15e92e04-d9db-4a02-9007-21aaae4d07c2 req-f647f914-05ef-45b1-b534-f6233ec23e16 tempest-VolumesSnapshotsTestJSON-762351040 None] Create snapshot completed successfully Apr 24 13:44:45 devstack cinder-volume[82046]: DEBUG cinder.coordination [req-fad431ff-a565-4b50-9562-cff80471a2d8 req-2271196e-5611-4579-9c54-0fa96c21a13f tempest-VolumesSnapshotsTestJSON-762351040 None] Acquiring lock "cinder-fc007886-2a0f-4fb0-9e31-4eb26272a56e-delete_snapshot" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:44:45 devstack cinder-volume[82046]: DEBUG cinder.coordination [req-fad431ff-a565-4b50-9562-cff80471a2d8 req-2271196e-5611-4579-9c54-0fa96c21a13f tempest-VolumesSnapshotsTestJSON-762351040 None] Lock "cinder-fc007886-2a0f-4fb0-9e31-4eb26272a56e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:44:45 devstack cinder-volume[82046]: DEBUG cinder.coordination [req-fad431ff-a565-4b50-9562-cff80471a2d8 req-2271196e-5611-4579-9c54-0fa96c21a13f tempest-VolumesSnapshotsTestJSON-762351040 None] Acquiring lock "cinder-quobyte-e7e312d0-2854-4c49-b9d6-e4cfae395ad8" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:44:45 devstack cinder-volume[82046]: DEBUG cinder.coordination [req-fad431ff-a565-4b50-9562-cff80471a2d8 req-2271196e-5611-4579-9c54-0fa96c21a13f tempest-VolumesSnapshotsTestJSON-762351040 None] Lock "cinder-quobyte-e7e312d0-2854-4c49-b9d6-e4cfae395ad8" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:44:45 devstack cinder-volume[82046]: DEBUG cinder.coordination [req-fad431ff-a565-4b50-9562-cff80471a2d8 req-2271196e-5611-4579-9c54-0fa96c21a13f tempest-VolumesSnapshotsTestJSON-762351040 None] Acquiring lock "cinder-quobyte-fc007886-2a0f-4fb0-9e31-4eb26272a56e" by "_delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:44:45 devstack cinder-volume[82046]: DEBUG cinder.coordination [req-fad431ff-a565-4b50-9562-cff80471a2d8 req-2271196e-5611-4579-9c54-0fa96c21a13f tempest-VolumesSnapshotsTestJSON-762351040 None] Lock "cinder-quobyte-fc007886-2a0f-4fb0-9e31-4eb26272a56e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:44:45 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [req-fad431ff-a565-4b50-9562-cff80471a2d8 req-2271196e-5611-4579-9c54-0fa96c21a13f tempest-VolumesSnapshotsTestJSON-762351040 None] Deleting offline snapshot fc007886-2a0f-4fb0-9e31-4eb26272a56e of volume e7e312d0-2854-4c49-b9d6-e4cfae395ad8 {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 13:44:45 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [req-fad431ff-a565-4b50-9562-cff80471a2d8 req-2271196e-5611-4579-9c54-0fa96c21a13f tempest-VolumesSnapshotsTestJSON-762351040 None] snapshot_file for this snap is: volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8.fc007886-2a0f-4fb0-9e31-4eb26272a56e {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 13:44:45 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[95293476-c5aa-499d-9680-fb45218e1b37]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:44:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-fad431ff-a565-4b50-9562-cff80471a2d8 req-2271196e-5611-4579-9c54-0fa96c21a13f tempest-VolumesSnapshotsTestJSON-762351040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8.fc007886-2a0f-4fb0-9e31-4eb26272a56e {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:44:45 devstack sudo[82790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8.fc007886-2a0f-4fb0-9e31-4eb26272a56e Apr 24 13:44:45 devstack sudo[82790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:44:46 devstack sudo[82786]: pam_unix(sudo:session): session closed for user root Apr 24 13:44:46 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-16d7b475-e77b-4e6d-af6e-77dfd05a4b91 tempest-DeleteServersTestJSON-259405003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b77d1676-813c-489f-85e9-17d24105bbf9 1073741824" returned: 0 in 1.417s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:44:46 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-16d7b475-e77b-4e6d-af6e-77dfd05a4b91 tempest-DeleteServersTestJSON-259405003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b77d1676-813c-489f-85e9-17d24105bbf9 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:44:46 devstack sudo[82809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b77d1676-813c-489f-85e9-17d24105bbf9 Apr 24 13:44:46 devstack sudo[82809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:44:47 devstack sudo[82790]: pam_unix(sudo:session): session closed for user root Apr 24 13:44:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-fad431ff-a565-4b50-9562-cff80471a2d8 req-2271196e-5611-4579-9c54-0fa96c21a13f tempest-VolumesSnapshotsTestJSON-762351040 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8.fc007886-2a0f-4fb0-9e31-4eb26272a56e" returned: 0 in 1.453s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:44:47 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [req-fad431ff-a565-4b50-9562-cff80471a2d8 req-2271196e-5611-4579-9c54-0fa96c21a13f tempest-VolumesSnapshotsTestJSON-762351040 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:44:47 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[07026afa-ca38-49f0-a3a4-063456b30dbd]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:44:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-fad431ff-a565-4b50-9562-cff80471a2d8 req-2271196e-5611-4579-9c54-0fa96c21a13f tempest-VolumesSnapshotsTestJSON-762351040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:44:47 devstack sudo[82816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8 Apr 24 13:44:47 devstack sudo[82816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:44:47 devstack sudo[82809]: pam_unix(sudo:session): session closed for user root Apr 24 13:44:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-16d7b475-e77b-4e6d-af6e-77dfd05a4b91 tempest-DeleteServersTestJSON-259405003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b77d1676-813c-489f-85e9-17d24105bbf9" returned: 0 in 0.985s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:44:47 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-16d7b475-e77b-4e6d-af6e-77dfd05a4b91 tempest-DeleteServersTestJSON-259405003 None] <== create_volume: return (2535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:44:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-16d7b475-e77b-4e6d-af6e-77dfd05a4b91 tempest-DeleteServersTestJSON-259405003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.547s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:44:47 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-16d7b475-e77b-4e6d-af6e-77dfd05a4b91 tempest-DeleteServersTestJSON-259405003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1388dfd1-52a0-4ba7-aad6-91d9672dd32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b77d1676-813c-489f-85e9-17d24105bbf9', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:44:47 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-16d7b475-e77b-4e6d-af6e-77dfd05a4b91 tempest-DeleteServersTestJSON-259405003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73072533-6e80-467d-b206-7014bb28956e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:44:47 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-16d7b475-e77b-4e6d-af6e-77dfd05a4b91 tempest-DeleteServersTestJSON-259405003 None] Volume volume-b77d1676-813c-489f-85e9-17d24105bbf9 (b77d1676-813c-489f-85e9-17d24105bbf9): created successfully Apr 24 13:44:47 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-16d7b475-e77b-4e6d-af6e-77dfd05a4b91 tempest-DeleteServersTestJSON-259405003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73072533-6e80-467d-b206-7014bb28956e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:44:47 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-16d7b475-e77b-4e6d-af6e-77dfd05a4b91 tempest-DeleteServersTestJSON-259405003 None] Flow 'volume_create_manager' (5a16c865-afa7-46ef-9450-53a95aa27da3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:44:47 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-16d7b475-e77b-4e6d-af6e-77dfd05a4b91 tempest-DeleteServersTestJSON-259405003 None] Created volume successfully. Apr 24 13:44:48 devstack sudo[82816]: pam_unix(sudo:session): session closed for user root Apr 24 13:44:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-fad431ff-a565-4b50-9562-cff80471a2d8 req-2271196e-5611-4579-9c54-0fa96c21a13f tempest-VolumesSnapshotsTestJSON-762351040 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8" returned: 0 in 1.184s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:44:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-fad431ff-a565-4b50-9562-cff80471a2d8 req-2271196e-5611-4579-9c54-0fa96c21a13f tempest-VolumesSnapshotsTestJSON-762351040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8.fc007886-2a0f-4fb0-9e31-4eb26272a56e {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:44:48 devstack sudo[82836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8.fc007886-2a0f-4fb0-9e31-4eb26272a56e Apr 24 13:44:48 devstack sudo[82836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:44:49 devstack sudo[82836]: pam_unix(sudo:session): session closed for user root Apr 24 13:44:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-fad431ff-a565-4b50-9562-cff80471a2d8 req-2271196e-5611-4579-9c54-0fa96c21a13f tempest-VolumesSnapshotsTestJSON-762351040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8.fc007886-2a0f-4fb0-9e31-4eb26272a56e" returned: 0 in 0.808s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:44:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-fad431ff-a565-4b50-9562-cff80471a2d8 req-2271196e-5611-4579-9c54-0fa96c21a13f tempest-VolumesSnapshotsTestJSON-762351040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8.fc007886-2a0f-4fb0-9e31-4eb26272a56e {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:44:49 devstack sudo[82847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8.fc007886-2a0f-4fb0-9e31-4eb26272a56e Apr 24 13:44:49 devstack sudo[82847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:44:49 devstack sudo[82847]: pam_unix(sudo:session): session closed for user root Apr 24 13:44:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-fad431ff-a565-4b50-9562-cff80471a2d8 req-2271196e-5611-4579-9c54-0fa96c21a13f tempest-VolumesSnapshotsTestJSON-762351040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8.fc007886-2a0f-4fb0-9e31-4eb26272a56e" returned: 0 in 0.596s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:44:49 devstack cinder-volume[82046]: DEBUG cinder.coordination [req-fad431ff-a565-4b50-9562-cff80471a2d8 req-2271196e-5611-4579-9c54-0fa96c21a13f tempest-VolumesSnapshotsTestJSON-762351040 None] Lock "cinder-quobyte-fc007886-2a0f-4fb0-9e31-4eb26272a56e" released by "_delete_snapshot" :: held 4.192s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:44:49 devstack cinder-volume[82046]: DEBUG cinder.coordination [req-fad431ff-a565-4b50-9562-cff80471a2d8 req-2271196e-5611-4579-9c54-0fa96c21a13f tempest-VolumesSnapshotsTestJSON-762351040 None] Lock "cinder-quobyte-e7e312d0-2854-4c49-b9d6-e4cfae395ad8" released by "delete_snapshot" :: held 4.215s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:44:49 devstack cinder-volume[82046]: WARNING cinder.quota [req-fad431ff-a565-4b50-9562-cff80471a2d8 req-2271196e-5611-4579-9c54-0fa96c21a13f tempest-VolumesSnapshotsTestJSON-762351040 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 24 13:44:49 devstack cinder-volume[82046]: WARNING cinder.quota [req-fad431ff-a565-4b50-9562-cff80471a2d8 req-2271196e-5611-4579-9c54-0fa96c21a13f tempest-VolumesSnapshotsTestJSON-762351040 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 24 13:44:49 devstack cinder-volume[82046]: DEBUG cinder.quota [req-fad431ff-a565-4b50-9562-cff80471a2d8 req-2271196e-5611-4579-9c54-0fa96c21a13f tempest-VolumesSnapshotsTestJSON-762351040 None] Created reservations ['4f2f369f-b888-4fc2-ae1d-c61956fe0ef0', '6e99ec2a-71b4-4810-b2a6-806404d5a872', '99539c0d-99b8-4a65-9bd6-d08433730322', '850e3dd4-13b8-42d9-adcc-4d42efa64ac2'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:44:49 devstack cinder-volume[82046]: INFO cinder.volume.manager [req-fad431ff-a565-4b50-9562-cff80471a2d8 req-2271196e-5611-4579-9c54-0fa96c21a13f tempest-VolumesSnapshotsTestJSON-762351040 None] Delete snapshot completed successfully. Apr 24 13:44:50 devstack cinder-volume[82046]: DEBUG cinder.coordination [req-fad431ff-a565-4b50-9562-cff80471a2d8 req-2271196e-5611-4579-9c54-0fa96c21a13f tempest-VolumesSnapshotsTestJSON-762351040 None] Lock "cinder-fc007886-2a0f-4fb0-9e31-4eb26272a56e-delete_snapshot" released by "delete_snapshot" :: held 4.465s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:44:50 devstack cinder-volume[82046]: DEBUG cinder.coordination [req-4542a64c-f600-4f58-81de-c7bd0e48ecfc req-87f708a6-fbf9-4eba-aede-e2ee3d44ab3f tempest-VolumesSnapshotsTestJSON-762351040 None] Acquiring lock "cinder-e7e312d0-2854-4c49-b9d6-e4cfae395ad8-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:44:50 devstack cinder-volume[82046]: DEBUG cinder.coordination [req-4542a64c-f600-4f58-81de-c7bd0e48ecfc req-87f708a6-fbf9-4eba-aede-e2ee3d44ab3f tempest-VolumesSnapshotsTestJSON-762351040 None] Lock "cinder-e7e312d0-2854-4c49-b9d6-e4cfae395ad8-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:44:50 devstack cinder-volume[82046]: DEBUG cinder.coordination [req-4542a64c-f600-4f58-81de-c7bd0e48ecfc req-87f708a6-fbf9-4eba-aede-e2ee3d44ab3f tempest-VolumesSnapshotsTestJSON-762351040 None] Acquiring lock "cinder-quobyte-e7e312d0-2854-4c49-b9d6-e4cfae395ad8" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:44:50 devstack cinder-volume[82046]: DEBUG cinder.coordination [req-4542a64c-f600-4f58-81de-c7bd0e48ecfc req-87f708a6-fbf9-4eba-aede-e2ee3d44ab3f tempest-VolumesSnapshotsTestJSON-762351040 None] Lock "cinder-quobyte-e7e312d0-2854-4c49-b9d6-e4cfae395ad8" acquired by "delete_volume" :: waited 0.040s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:44:50 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[d120524e-32b0-4345-bb80-0ce175d4618b]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:44:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-4542a64c-f600-4f58-81de-c7bd0e48ecfc req-87f708a6-fbf9-4eba-aede-e2ee3d44ab3f tempest-VolumesSnapshotsTestJSON-762351040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:44:50 devstack sudo[82858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8 Apr 24 13:44:50 devstack sudo[82858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:44:51 devstack sudo[82858]: pam_unix(sudo:session): session closed for user root Apr 24 13:44:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-4542a64c-f600-4f58-81de-c7bd0e48ecfc req-87f708a6-fbf9-4eba-aede-e2ee3d44ab3f tempest-VolumesSnapshotsTestJSON-762351040 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8" returned: 0 in 1.231s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:44:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-4542a64c-f600-4f58-81de-c7bd0e48ecfc req-87f708a6-fbf9-4eba-aede-e2ee3d44ab3f tempest-VolumesSnapshotsTestJSON-762351040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:44:51 devstack sudo[82904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8 Apr 24 13:44:51 devstack sudo[82904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:44:52 devstack sudo[82904]: pam_unix(sudo:session): session closed for user root Apr 24 13:44:52 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-4542a64c-f600-4f58-81de-c7bd0e48ecfc req-87f708a6-fbf9-4eba-aede-e2ee3d44ab3f tempest-VolumesSnapshotsTestJSON-762351040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e7e312d0-2854-4c49-b9d6-e4cfae395ad8" returned: 0 in 0.791s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:44:52 devstack cinder-volume[82046]: DEBUG cinder.coordination [req-4542a64c-f600-4f58-81de-c7bd0e48ecfc req-87f708a6-fbf9-4eba-aede-e2ee3d44ab3f tempest-VolumesSnapshotsTestJSON-762351040 None] Lock "cinder-quobyte-e7e312d0-2854-4c49-b9d6-e4cfae395ad8" released by "delete_volume" :: held 2.099s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:44:52 devstack cinder-volume[82046]: WARNING cinder.quota [req-4542a64c-f600-4f58-81de-c7bd0e48ecfc req-87f708a6-fbf9-4eba-aede-e2ee3d44ab3f tempest-VolumesSnapshotsTestJSON-762351040 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 24 13:44:52 devstack cinder-volume[82046]: DEBUG cinder.quota [req-4542a64c-f600-4f58-81de-c7bd0e48ecfc req-87f708a6-fbf9-4eba-aede-e2ee3d44ab3f tempest-VolumesSnapshotsTestJSON-762351040 None] Created reservations ['5f6846bc-cbe4-4145-a577-dbd02a6f6b9f', '7c12f225-056c-461e-91d8-b4fa22f7d13d', 'd80a09f6-7a0b-4a00-9f57-b60a4341f64b', '8e0be69e-3e7b-407e-ba62-ec590b198f82'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:44:52 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [req-4542a64c-f600-4f58-81de-c7bd0e48ecfc req-87f708a6-fbf9-4eba-aede-e2ee3d44ab3f tempest-VolumesSnapshotsTestJSON-762351040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:44:52 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [req-4542a64c-f600-4f58-81de-c7bd0e48ecfc req-87f708a6-fbf9-4eba-aede-e2ee3d44ab3f tempest-VolumesSnapshotsTestJSON-762351040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:44:52 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [req-4542a64c-f600-4f58-81de-c7bd0e48ecfc req-87f708a6-fbf9-4eba-aede-e2ee3d44ab3f tempest-VolumesSnapshotsTestJSON-762351040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:44:52 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [req-4542a64c-f600-4f58-81de-c7bd0e48ecfc req-87f708a6-fbf9-4eba-aede-e2ee3d44ab3f tempest-VolumesSnapshotsTestJSON-762351040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:44:52 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [req-4542a64c-f600-4f58-81de-c7bd0e48ecfc req-87f708a6-fbf9-4eba-aede-e2ee3d44ab3f tempest-VolumesSnapshotsTestJSON-762351040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:44:52 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-4542a64c-f600-4f58-81de-c7bd0e48ecfc req-87f708a6-fbf9-4eba-aede-e2ee3d44ab3f tempest-VolumesSnapshotsTestJSON-762351040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:44:52 devstack sudo[82920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:44:52 devstack sudo[82920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:44:53 devstack sudo[82920]: pam_unix(sudo:session): session closed for user root Apr 24 13:44:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-4542a64c-f600-4f58-81de-c7bd0e48ecfc req-87f708a6-fbf9-4eba-aede-e2ee3d44ab3f tempest-VolumesSnapshotsTestJSON-762351040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.510s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:44:53 devstack cinder-volume[82046]: DEBUG cinder.manager [req-4542a64c-f600-4f58-81de-c7bd0e48ecfc req-87f708a6-fbf9-4eba-aede-e2ee3d44ab3f tempest-VolumesSnapshotsTestJSON-762351040 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:44:53 devstack cinder-volume[82046]: INFO cinder.volume.manager [req-4542a64c-f600-4f58-81de-c7bd0e48ecfc req-87f708a6-fbf9-4eba-aede-e2ee3d44ab3f tempest-VolumesSnapshotsTestJSON-762351040 None] Deleted volume successfully. Apr 24 13:44:53 devstack cinder-volume[82046]: DEBUG cinder.coordination [req-4542a64c-f600-4f58-81de-c7bd0e48ecfc req-87f708a6-fbf9-4eba-aede-e2ee3d44ab3f tempest-VolumesSnapshotsTestJSON-762351040 None] Lock "cinder-e7e312d0-2854-4c49-b9d6-e4cfae395ad8-delete_volume" released by "delete_volume" :: held 2.974s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:44:53 devstack cinder-volume[82046]: WARNING py.warnings [req-07aa2d52-5a5b-4b06-9df7-f4a8aba053bf req-5a6c7c3b-c482-4b16-8345-9f4a91699de0 tempest-DeleteServersTestJSON-259405003 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Apr 24 13:44:53 devstack cinder-volume[82046]: .first() Apr 24 13:44:53 devstack cinder-volume[82046]: Apr 24 13:44:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [req-07aa2d52-5a5b-4b06-9df7-f4a8aba053bf req-5a6c7c3b-c482-4b16-8345-9f4a91699de0 tempest-DeleteServersTestJSON-259405003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:44:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [req-07aa2d52-5a5b-4b06-9df7-f4a8aba053bf req-5a6c7c3b-c482-4b16-8345-9f4a91699de0 tempest-DeleteServersTestJSON-259405003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:44:53 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3177d8d-7afa-4116-8653-0004a71899ed]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:44:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-07aa2d52-5a5b-4b06-9df7-f4a8aba053bf req-5a6c7c3b-c482-4b16-8345-9f4a91699de0 tempest-DeleteServersTestJSON-259405003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b77d1676-813c-489f-85e9-17d24105bbf9 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:44:54 devstack sudo[82937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b77d1676-813c-489f-85e9-17d24105bbf9 Apr 24 13:44:54 devstack sudo[82937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:44:54 devstack sudo[82937]: pam_unix(sudo:session): session closed for user root Apr 24 13:44:54 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-07aa2d52-5a5b-4b06-9df7-f4a8aba053bf req-5a6c7c3b-c482-4b16-8345-9f4a91699de0 tempest-DeleteServersTestJSON-259405003 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b77d1676-813c-489f-85e9-17d24105bbf9" returned: 0 in 0.811s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:44:54 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [req-07aa2d52-5a5b-4b06-9df7-f4a8aba053bf req-5a6c7c3b-c482-4b16-8345-9f4a91699de0 tempest-DeleteServersTestJSON-259405003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.840s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:44:54 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-07aa2d52-5a5b-4b06-9df7-f4a8aba053bf req-5a6c7c3b-c482-4b16-8345-9f4a91699de0 tempest-DeleteServersTestJSON-259405003 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23', 'name': 'volume-b77d1676-813c-489f-85e9-17d24105bbf9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '25ecb325-46ac-4500-94cd-b39eec334c4a', 'enforce_multipath': True} {{(pid=82046) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 24 13:44:54 devstack cinder-volume[82046]: INFO cinder.volume.manager [req-07aa2d52-5a5b-4b06-9df7-f4a8aba053bf req-5a6c7c3b-c482-4b16-8345-9f4a91699de0 tempest-DeleteServersTestJSON-259405003 None] attachment_update completed successfully. Apr 24 13:44:59 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [req-bfe2ccbb-a8a7-4b5f-8caa-b8b88fc21074 req-9686bc47-cf2e-4330-b33a-f7f0fb492cb6 tempest-VolumesGetTestJSON-1118056000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:44:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-bfe2ccbb-a8a7-4b5f-8caa-b8b88fc21074 req-9686bc47-cf2e-4330-b33a-f7f0fb492cb6 tempest-VolumesGetTestJSON-1118056000 None] Flow 'volume_create_manager' (f223e116-1a59-469c-bd96-26a0e10e4611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:44:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-bfe2ccbb-a8a7-4b5f-8caa-b8b88fc21074 req-9686bc47-cf2e-4330-b33a-f7f0fb492cb6 tempest-VolumesGetTestJSON-1118056000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff07d512-612d-489a-be40-609eeca99939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:44:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-bfe2ccbb-a8a7-4b5f-8caa-b8b88fc21074 req-9686bc47-cf2e-4330-b33a-f7f0fb492cb6 tempest-VolumesGetTestJSON-1118056000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff07d512-612d-489a-be40-609eeca99939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:44:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1022488809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea158d41-a675-4fc8-b95f-f6ba8fe56a8a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6299708b3c564cff9ae3e6c27a915cbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:44:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:44:59Z,use_quota=True,user_id='37dd8ec29fc94e9b9e1fade4aa1c8b30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:44:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-bfe2ccbb-a8a7-4b5f-8caa-b8b88fc21074 req-9686bc47-cf2e-4330-b33a-f7f0fb492cb6 tempest-VolumesGetTestJSON-1118056000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9945fada-d084-4692-b19d-dfb9d61bd564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:44:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-bfe2ccbb-a8a7-4b5f-8caa-b8b88fc21074 req-9686bc47-cf2e-4330-b33a-f7f0fb492cb6 tempest-VolumesGetTestJSON-1118056000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9945fada-d084-4692-b19d-dfb9d61bd564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:44:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-bfe2ccbb-a8a7-4b5f-8caa-b8b88fc21074 req-9686bc47-cf2e-4330-b33a-f7f0fb492cb6 tempest-VolumesGetTestJSON-1118056000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4788590d-b9bb-4127-a87e-83f5a9193c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:44:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-bfe2ccbb-a8a7-4b5f-8caa-b8b88fc21074 req-9686bc47-cf2e-4330-b33a-f7f0fb492cb6 tempest-VolumesGetTestJSON-1118056000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4788590d-b9bb-4127-a87e-83f5a9193c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea158d41-a675-4fc8-b95f-f6ba8fe56a8a', 'volume_name': 'volume-ea158d41-a675-4fc8-b95f-f6ba8fe56a8a', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:44:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-bfe2ccbb-a8a7-4b5f-8caa-b8b88fc21074 req-9686bc47-cf2e-4330-b33a-f7f0fb492cb6 tempest-VolumesGetTestJSON-1118056000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a876839-5046-42ae-8a22-5b2ef29bde6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:44:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-bfe2ccbb-a8a7-4b5f-8caa-b8b88fc21074 req-9686bc47-cf2e-4330-b33a-f7f0fb492cb6 tempest-VolumesGetTestJSON-1118056000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a876839-5046-42ae-8a22-5b2ef29bde6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:44:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-bfe2ccbb-a8a7-4b5f-8caa-b8b88fc21074 req-9686bc47-cf2e-4330-b33a-f7f0fb492cb6 tempest-VolumesGetTestJSON-1118056000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c8b01ef-771f-4976-a39a-0e8a9426d78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:44:59 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [req-bfe2ccbb-a8a7-4b5f-8caa-b8b88fc21074 req-9686bc47-cf2e-4330-b33a-f7f0fb492cb6 tempest-VolumesGetTestJSON-1118056000 None] Volume ea158d41-a675-4fc8-b95f-f6ba8fe56a8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea158d41-a675-4fc8-b95f-f6ba8fe56a8a', 'volume_size': 1} Apr 24 13:44:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [req-bfe2ccbb-a8a7-4b5f-8caa-b8b88fc21074 req-9686bc47-cf2e-4330-b33a-f7f0fb492cb6 tempest-VolumesGetTestJSON-1118056000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:44:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [req-bfe2ccbb-a8a7-4b5f-8caa-b8b88fc21074 req-9686bc47-cf2e-4330-b33a-f7f0fb492cb6 tempest-VolumesGetTestJSON-1118056000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:44:59 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [req-bfe2ccbb-a8a7-4b5f-8caa-b8b88fc21074 req-9686bc47-cf2e-4330-b33a-f7f0fb492cb6 tempest-VolumesGetTestJSON-1118056000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:44:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1022488809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea158d41-a675-4fc8-b95f-f6ba8fe56a8a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6299708b3c564cff9ae3e6c27a915cbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:44:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:44:59Z,use_quota=True,user_id='37dd8ec29fc94e9b9e1fade4aa1c8b30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:44:59 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [req-bfe2ccbb-a8a7-4b5f-8caa-b8b88fc21074 req-9686bc47-cf2e-4330-b33a-f7f0fb492cb6 tempest-VolumesGetTestJSON-1118056000 None] Creating volume ea158d41-a675-4fc8-b95f-f6ba8fe56a8a {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:44:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [req-bfe2ccbb-a8a7-4b5f-8caa-b8b88fc21074 req-9686bc47-cf2e-4330-b33a-f7f0fb492cb6 tempest-VolumesGetTestJSON-1118056000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:44:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [req-bfe2ccbb-a8a7-4b5f-8caa-b8b88fc21074 req-9686bc47-cf2e-4330-b33a-f7f0fb492cb6 tempest-VolumesGetTestJSON-1118056000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:44:59 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [req-bfe2ccbb-a8a7-4b5f-8caa-b8b88fc21074 req-9686bc47-cf2e-4330-b33a-f7f0fb492cb6 tempest-VolumesGetTestJSON-1118056000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:44:59 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [req-bfe2ccbb-a8a7-4b5f-8caa-b8b88fc21074 req-9686bc47-cf2e-4330-b33a-f7f0fb492cb6 tempest-VolumesGetTestJSON-1118056000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:44:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [req-bfe2ccbb-a8a7-4b5f-8caa-b8b88fc21074 req-9686bc47-cf2e-4330-b33a-f7f0fb492cb6 tempest-VolumesGetTestJSON-1118056000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:44:59 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [req-bfe2ccbb-a8a7-4b5f-8caa-b8b88fc21074 req-9686bc47-cf2e-4330-b33a-f7f0fb492cb6 tempest-VolumesGetTestJSON-1118056000 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:44:59 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [req-bfe2ccbb-a8a7-4b5f-8caa-b8b88fc21074 req-9686bc47-cf2e-4330-b33a-f7f0fb492cb6 tempest-VolumesGetTestJSON-1118056000 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:44:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-bfe2ccbb-a8a7-4b5f-8caa-b8b88fc21074 req-9686bc47-cf2e-4330-b33a-f7f0fb492cb6 tempest-VolumesGetTestJSON-1118056000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-ea158d41-a675-4fc8-b95f-f6ba8fe56a8a 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:44:59 devstack sudo[83383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-ea158d41-a675-4fc8-b95f-f6ba8fe56a8a 1073741824 Apr 24 13:44:59 devstack sudo[83383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:00 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-947f968a-4eba-49ed-8de6-d83134665a10 tempest-VolumesAdminNegativeTest-431650060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:45:00 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-947f968a-4eba-49ed-8de6-d83134665a10 tempest-VolumesAdminNegativeTest-431650060 None] Flow 'volume_create_manager' (1c9b0dec-9deb-452b-82c3-2829661401a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:45:00 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-947f968a-4eba-49ed-8de6-d83134665a10 tempest-VolumesAdminNegativeTest-431650060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41b57108-c71f-4e2f-8cb5-f0d13b6e3f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:45:00 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-947f968a-4eba-49ed-8de6-d83134665a10 tempest-VolumesAdminNegativeTest-431650060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41b57108-c71f-4e2f-8cb5-f0d13b6e3f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:45:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1132775686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=925d0675-3012-494b-9d27-0ed6b75cd440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4b970adaf2c4e33a73d65e29621bb74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:45:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:45:00Z,use_quota=True,user_id='d71488d2ba834bcda7f646c7f8163b2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:45:00 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-947f968a-4eba-49ed-8de6-d83134665a10 tempest-VolumesAdminNegativeTest-431650060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (000759b6-368d-438a-9209-9fc922e4694d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:45:00 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-947f968a-4eba-49ed-8de6-d83134665a10 tempest-VolumesAdminNegativeTest-431650060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (000759b6-368d-438a-9209-9fc922e4694d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:45:00 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-947f968a-4eba-49ed-8de6-d83134665a10 tempest-VolumesAdminNegativeTest-431650060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ecb7098-aac0-48da-a53c-fe6bed55a354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:45:00 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-947f968a-4eba-49ed-8de6-d83134665a10 tempest-VolumesAdminNegativeTest-431650060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ecb7098-aac0-48da-a53c-fe6bed55a354) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '925d0675-3012-494b-9d27-0ed6b75cd440', 'volume_name': 'volume-925d0675-3012-494b-9d27-0ed6b75cd440', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:45:00 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-947f968a-4eba-49ed-8de6-d83134665a10 tempest-VolumesAdminNegativeTest-431650060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dc3e724-4170-4a19-8fc4-971ac082b195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:45:00 devstack sudo[83383]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:00 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-947f968a-4eba-49ed-8de6-d83134665a10 tempest-VolumesAdminNegativeTest-431650060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dc3e724-4170-4a19-8fc4-971ac082b195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:45:00 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-947f968a-4eba-49ed-8de6-d83134665a10 tempest-VolumesAdminNegativeTest-431650060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e631b18-7b69-432b-94b4-1b8ca66bc17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:45:00 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-947f968a-4eba-49ed-8de6-d83134665a10 tempest-VolumesAdminNegativeTest-431650060 None] Volume 925d0675-3012-494b-9d27-0ed6b75cd440: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-925d0675-3012-494b-9d27-0ed6b75cd440', 'volume_size': 1} Apr 24 13:45:00 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-947f968a-4eba-49ed-8de6-d83134665a10 tempest-VolumesAdminNegativeTest-431650060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:45:00 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-bfe2ccbb-a8a7-4b5f-8caa-b8b88fc21074 req-9686bc47-cf2e-4330-b33a-f7f0fb492cb6 tempest-VolumesGetTestJSON-1118056000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-ea158d41-a675-4fc8-b95f-f6ba8fe56a8a 1073741824" returned: 0 in 1.040s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:00 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-bfe2ccbb-a8a7-4b5f-8caa-b8b88fc21074 req-9686bc47-cf2e-4330-b33a-f7f0fb492cb6 tempest-VolumesGetTestJSON-1118056000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-ea158d41-a675-4fc8-b95f-f6ba8fe56a8a {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:00 devstack sudo[83388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-ea158d41-a675-4fc8-b95f-f6ba8fe56a8a Apr 24 13:45:00 devstack sudo[83388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:01 devstack sudo[83388]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-bfe2ccbb-a8a7-4b5f-8caa-b8b88fc21074 req-9686bc47-cf2e-4330-b33a-f7f0fb492cb6 tempest-VolumesGetTestJSON-1118056000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-ea158d41-a675-4fc8-b95f-f6ba8fe56a8a" returned: 0 in 0.584s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:01 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [req-bfe2ccbb-a8a7-4b5f-8caa-b8b88fc21074 req-9686bc47-cf2e-4330-b33a-f7f0fb492cb6 tempest-VolumesGetTestJSON-1118056000 None] <== create_volume: return (1676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:45:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [req-bfe2ccbb-a8a7-4b5f-8caa-b8b88fc21074 req-9686bc47-cf2e-4330-b33a-f7f0fb492cb6 tempest-VolumesGetTestJSON-1118056000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.679s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:45:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-947f968a-4eba-49ed-8de6-d83134665a10 tempest-VolumesAdminNegativeTest-431650060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.638s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:45:01 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-947f968a-4eba-49ed-8de6-d83134665a10 tempest-VolumesAdminNegativeTest-431650060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:45:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1132775686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=925d0675-3012-494b-9d27-0ed6b75cd440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4b970adaf2c4e33a73d65e29621bb74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:45:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:45:00Z,use_quota=True,user_id='d71488d2ba834bcda7f646c7f8163b2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:45:01 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-947f968a-4eba-49ed-8de6-d83134665a10 tempest-VolumesAdminNegativeTest-431650060 None] Creating volume 925d0675-3012-494b-9d27-0ed6b75cd440 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:45:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-947f968a-4eba-49ed-8de6-d83134665a10 tempest-VolumesAdminNegativeTest-431650060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:45:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-947f968a-4eba-49ed-8de6-d83134665a10 tempest-VolumesAdminNegativeTest-431650060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:45:01 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-947f968a-4eba-49ed-8de6-d83134665a10 tempest-VolumesAdminNegativeTest-431650060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:45:01 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-947f968a-4eba-49ed-8de6-d83134665a10 tempest-VolumesAdminNegativeTest-431650060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:45:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-947f968a-4eba-49ed-8de6-d83134665a10 tempest-VolumesAdminNegativeTest-431650060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:45:01 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-947f968a-4eba-49ed-8de6-d83134665a10 tempest-VolumesAdminNegativeTest-431650060 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:45:01 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-947f968a-4eba-49ed-8de6-d83134665a10 tempest-VolumesAdminNegativeTest-431650060 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:45:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-947f968a-4eba-49ed-8de6-d83134665a10 tempest-VolumesAdminNegativeTest-431650060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-925d0675-3012-494b-9d27-0ed6b75cd440 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:01 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-bfe2ccbb-a8a7-4b5f-8caa-b8b88fc21074 req-9686bc47-cf2e-4330-b33a-f7f0fb492cb6 tempest-VolumesGetTestJSON-1118056000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c8b01ef-771f-4976-a39a-0e8a9426d78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea158d41-a675-4fc8-b95f-f6ba8fe56a8a', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:45:01 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-bfe2ccbb-a8a7-4b5f-8caa-b8b88fc21074 req-9686bc47-cf2e-4330-b33a-f7f0fb492cb6 tempest-VolumesGetTestJSON-1118056000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a0bf9f3-81cc-4bef-82ac-fb210ee6fb54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:45:01 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [req-bfe2ccbb-a8a7-4b5f-8caa-b8b88fc21074 req-9686bc47-cf2e-4330-b33a-f7f0fb492cb6 tempest-VolumesGetTestJSON-1118056000 None] Volume volume-ea158d41-a675-4fc8-b95f-f6ba8fe56a8a (ea158d41-a675-4fc8-b95f-f6ba8fe56a8a): created successfully Apr 24 13:45:01 devstack sudo[83391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-925d0675-3012-494b-9d27-0ed6b75cd440 1073741824 Apr 24 13:45:01 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-bfe2ccbb-a8a7-4b5f-8caa-b8b88fc21074 req-9686bc47-cf2e-4330-b33a-f7f0fb492cb6 tempest-VolumesGetTestJSON-1118056000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a0bf9f3-81cc-4bef-82ac-fb210ee6fb54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:45:01 devstack sudo[83391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:01 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-bfe2ccbb-a8a7-4b5f-8caa-b8b88fc21074 req-9686bc47-cf2e-4330-b33a-f7f0fb492cb6 tempest-VolumesGetTestJSON-1118056000 None] Flow 'volume_create_manager' (f223e116-1a59-469c-bd96-26a0e10e4611) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:45:01 devstack cinder-volume[82046]: INFO cinder.volume.manager [req-bfe2ccbb-a8a7-4b5f-8caa-b8b88fc21074 req-9686bc47-cf2e-4330-b33a-f7f0fb492cb6 tempest-VolumesGetTestJSON-1118056000 None] Created volume successfully. Apr 24 13:45:02 devstack sudo[83391]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-947f968a-4eba-49ed-8de6-d83134665a10 tempest-VolumesAdminNegativeTest-431650060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-925d0675-3012-494b-9d27-0ed6b75cd440 1073741824" returned: 0 in 1.131s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-947f968a-4eba-49ed-8de6-d83134665a10 tempest-VolumesAdminNegativeTest-431650060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-925d0675-3012-494b-9d27-0ed6b75cd440 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:02 devstack sudo[83405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-925d0675-3012-494b-9d27-0ed6b75cd440 Apr 24 13:45:02 devstack sudo[83405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:02 devstack cinder-volume[82046]: DEBUG cinder.coordination [req-982e01ca-ab31-4138-9720-69c8333be0b1 req-5d0663f2-228a-4866-b791-a138ed7e056a tempest-VolumesGetTestJSON-1118056000 None] Acquiring lock "cinder-ea158d41-a675-4fc8-b95f-f6ba8fe56a8a-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:45:02 devstack cinder-volume[82046]: DEBUG cinder.coordination [req-982e01ca-ab31-4138-9720-69c8333be0b1 req-5d0663f2-228a-4866-b791-a138ed7e056a tempest-VolumesGetTestJSON-1118056000 None] Lock "cinder-ea158d41-a675-4fc8-b95f-f6ba8fe56a8a-delete_volume" acquired by "delete_volume" :: waited 0.114s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:45:02 devstack cinder-volume[82046]: DEBUG cinder.coordination [req-982e01ca-ab31-4138-9720-69c8333be0b1 req-5d0663f2-228a-4866-b791-a138ed7e056a tempest-VolumesGetTestJSON-1118056000 None] Acquiring lock "cinder-quobyte-ea158d41-a675-4fc8-b95f-f6ba8fe56a8a" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:45:02 devstack cinder-volume[82046]: DEBUG cinder.coordination [req-982e01ca-ab31-4138-9720-69c8333be0b1 req-5d0663f2-228a-4866-b791-a138ed7e056a tempest-VolumesGetTestJSON-1118056000 None] Lock "cinder-quobyte-ea158d41-a675-4fc8-b95f-f6ba8fe56a8a" acquired by "delete_volume" :: waited 0.023s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:45:03 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a8d581-b738-4f1a-a58f-2990400fd564]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:45:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-982e01ca-ab31-4138-9720-69c8333be0b1 req-5d0663f2-228a-4866-b791-a138ed7e056a tempest-VolumesGetTestJSON-1118056000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-ea158d41-a675-4fc8-b95f-f6ba8fe56a8a {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:03 devstack sudo[83413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-ea158d41-a675-4fc8-b95f-f6ba8fe56a8a Apr 24 13:45:03 devstack sudo[83413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:03 devstack sudo[83405]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-947f968a-4eba-49ed-8de6-d83134665a10 tempest-VolumesAdminNegativeTest-431650060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-925d0675-3012-494b-9d27-0ed6b75cd440" returned: 0 in 0.900s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:03 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-947f968a-4eba-49ed-8de6-d83134665a10 tempest-VolumesAdminNegativeTest-431650060 None] <== create_volume: return (2136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:45:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-947f968a-4eba-49ed-8de6-d83134665a10 tempest-VolumesAdminNegativeTest-431650060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.140s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:45:03 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-947f968a-4eba-49ed-8de6-d83134665a10 tempest-VolumesAdminNegativeTest-431650060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e631b18-7b69-432b-94b4-1b8ca66bc17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-925d0675-3012-494b-9d27-0ed6b75cd440', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:45:03 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-947f968a-4eba-49ed-8de6-d83134665a10 tempest-VolumesAdminNegativeTest-431650060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35c997ce-cacc-4d23-9fe9-948ca8e676c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:45:03 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-947f968a-4eba-49ed-8de6-d83134665a10 tempest-VolumesAdminNegativeTest-431650060 None] Volume volume-925d0675-3012-494b-9d27-0ed6b75cd440 (925d0675-3012-494b-9d27-0ed6b75cd440): created successfully Apr 24 13:45:03 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-947f968a-4eba-49ed-8de6-d83134665a10 tempest-VolumesAdminNegativeTest-431650060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35c997ce-cacc-4d23-9fe9-948ca8e676c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:45:03 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-947f968a-4eba-49ed-8de6-d83134665a10 tempest-VolumesAdminNegativeTest-431650060 None] Flow 'volume_create_manager' (1c9b0dec-9deb-452b-82c3-2829661401a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:45:03 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-947f968a-4eba-49ed-8de6-d83134665a10 tempest-VolumesAdminNegativeTest-431650060 None] Created volume successfully. Apr 24 13:45:04 devstack sudo[83413]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:04 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-982e01ca-ab31-4138-9720-69c8333be0b1 req-5d0663f2-228a-4866-b791-a138ed7e056a tempest-VolumesGetTestJSON-1118056000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-ea158d41-a675-4fc8-b95f-f6ba8fe56a8a" returned: 0 in 1.497s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:04 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-982e01ca-ab31-4138-9720-69c8333be0b1 req-5d0663f2-228a-4866-b791-a138ed7e056a tempest-VolumesGetTestJSON-1118056000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-ea158d41-a675-4fc8-b95f-f6ba8fe56a8a {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:04 devstack sudo[83463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-ea158d41-a675-4fc8-b95f-f6ba8fe56a8a Apr 24 13:45:04 devstack sudo[83463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:04 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e16048e5-8c4a-4540-ad32-51c750935a53 tempest-VolumesAdminNegativeTest-431650060 None] Acquiring lock "cinder-925d0675-3012-494b-9d27-0ed6b75cd440-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:45:04 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e16048e5-8c4a-4540-ad32-51c750935a53 tempest-VolumesAdminNegativeTest-431650060 None] Lock "cinder-925d0675-3012-494b-9d27-0ed6b75cd440-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:45:04 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e16048e5-8c4a-4540-ad32-51c750935a53 tempest-VolumesAdminNegativeTest-431650060 None] Acquiring lock "cinder-quobyte-925d0675-3012-494b-9d27-0ed6b75cd440" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:45:04 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e16048e5-8c4a-4540-ad32-51c750935a53 tempest-VolumesAdminNegativeTest-431650060 None] Lock "cinder-quobyte-925d0675-3012-494b-9d27-0ed6b75cd440" acquired by "delete_volume" :: waited 0.071s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:45:05 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[45203ad5-a5f6-4ac5-8989-944d686b5b51]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:45:05 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e16048e5-8c4a-4540-ad32-51c750935a53 tempest-VolumesAdminNegativeTest-431650060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-925d0675-3012-494b-9d27-0ed6b75cd440 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:05 devstack sudo[83465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-925d0675-3012-494b-9d27-0ed6b75cd440 Apr 24 13:45:05 devstack sudo[83465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:05 devstack sudo[83463]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:05 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-982e01ca-ab31-4138-9720-69c8333be0b1 req-5d0663f2-228a-4866-b791-a138ed7e056a tempest-VolumesGetTestJSON-1118056000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-ea158d41-a675-4fc8-b95f-f6ba8fe56a8a" returned: 0 in 1.152s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:05 devstack cinder-volume[82046]: DEBUG cinder.coordination [req-982e01ca-ab31-4138-9720-69c8333be0b1 req-5d0663f2-228a-4866-b791-a138ed7e056a tempest-VolumesGetTestJSON-1118056000 None] Lock "cinder-quobyte-ea158d41-a675-4fc8-b95f-f6ba8fe56a8a" released by "delete_volume" :: held 2.783s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:45:05 devstack cinder-volume[82046]: DEBUG cinder.quota [req-982e01ca-ab31-4138-9720-69c8333be0b1 req-5d0663f2-228a-4866-b791-a138ed7e056a tempest-VolumesGetTestJSON-1118056000 None] Created reservations ['17a8005d-e746-4567-b6f0-b4499fea6795', 'e6e81c9b-4742-4099-8a8f-2af7ecab9211', '8a389b51-190d-41e4-91f5-b91eb13dc4b7', 'b64059b1-e404-4a66-920a-534ee067e9c7'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:45:05 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [req-982e01ca-ab31-4138-9720-69c8333be0b1 req-5d0663f2-228a-4866-b791-a138ed7e056a tempest-VolumesGetTestJSON-1118056000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:45:05 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [req-982e01ca-ab31-4138-9720-69c8333be0b1 req-5d0663f2-228a-4866-b791-a138ed7e056a tempest-VolumesGetTestJSON-1118056000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:45:05 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [req-982e01ca-ab31-4138-9720-69c8333be0b1 req-5d0663f2-228a-4866-b791-a138ed7e056a tempest-VolumesGetTestJSON-1118056000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:45:05 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [req-982e01ca-ab31-4138-9720-69c8333be0b1 req-5d0663f2-228a-4866-b791-a138ed7e056a tempest-VolumesGetTestJSON-1118056000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:45:05 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [req-982e01ca-ab31-4138-9720-69c8333be0b1 req-5d0663f2-228a-4866-b791-a138ed7e056a tempest-VolumesGetTestJSON-1118056000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:45:05 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-982e01ca-ab31-4138-9720-69c8333be0b1 req-5d0663f2-228a-4866-b791-a138ed7e056a tempest-VolumesGetTestJSON-1118056000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:06 devstack sudo[83474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:45:06 devstack sudo[83474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:06 devstack sudo[83465]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e16048e5-8c4a-4540-ad32-51c750935a53 tempest-VolumesAdminNegativeTest-431650060 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-925d0675-3012-494b-9d27-0ed6b75cd440" returned: 0 in 1.130s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e16048e5-8c4a-4540-ad32-51c750935a53 tempest-VolumesAdminNegativeTest-431650060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-925d0675-3012-494b-9d27-0ed6b75cd440 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:06 devstack sudo[83476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-925d0675-3012-494b-9d27-0ed6b75cd440 Apr 24 13:45:06 devstack sudo[83476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:06 devstack cinder-volume[82046]: INFO cinder.volume.manager [req-44dacad5-5ce3-4f31-977e-f96ce2929615 req-67e6bba8-d39b-469f-a601-ff7e2d588690 tempest-DeleteServersTestJSON-259405003 None] Terminate volume connection completed successfully. Apr 24 13:45:06 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-44dacad5-5ce3-4f31-977e-f96ce2929615 req-67e6bba8-d39b-469f-a601-ff7e2d588690 tempest-DeleteServersTestJSON-259405003 None] Deleting attachment 25ecb325-46ac-4500-94cd-b39eec334c4a. {{(pid=82046) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 24 13:45:06 devstack sudo[83474]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-982e01ca-ab31-4138-9720-69c8333be0b1 req-5d0663f2-228a-4866-b791-a138ed7e056a tempest-VolumesGetTestJSON-1118056000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.899s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:06 devstack cinder-volume[82046]: DEBUG cinder.manager [req-982e01ca-ab31-4138-9720-69c8333be0b1 req-5d0663f2-228a-4866-b791-a138ed7e056a tempest-VolumesGetTestJSON-1118056000 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:45:06 devstack cinder-volume[82046]: INFO cinder.volume.manager [req-982e01ca-ab31-4138-9720-69c8333be0b1 req-5d0663f2-228a-4866-b791-a138ed7e056a tempest-VolumesGetTestJSON-1118056000 None] Deleted volume successfully. Apr 24 13:45:06 devstack cinder-volume[82046]: DEBUG cinder.coordination [req-982e01ca-ab31-4138-9720-69c8333be0b1 req-5d0663f2-228a-4866-b791-a138ed7e056a tempest-VolumesGetTestJSON-1118056000 None] Lock "cinder-ea158d41-a675-4fc8-b95f-f6ba8fe56a8a-delete_volume" released by "delete_volume" :: held 4.011s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:45:07 devstack sudo[83476]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e16048e5-8c4a-4540-ad32-51c750935a53 tempest-VolumesAdminNegativeTest-431650060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-925d0675-3012-494b-9d27-0ed6b75cd440" returned: 0 in 1.185s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:07 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e16048e5-8c4a-4540-ad32-51c750935a53 tempest-VolumesAdminNegativeTest-431650060 None] Lock "cinder-quobyte-925d0675-3012-494b-9d27-0ed6b75cd440" released by "delete_volume" :: held 2.401s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:45:07 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-e16048e5-8c4a-4540-ad32-51c750935a53 tempest-VolumesAdminNegativeTest-431650060 None] Created reservations ['4d78c01a-5671-4807-a5e3-7ccfde81202e', '0971ba3f-e328-4d4b-8ab2-a88e6f6ced5f', '15b77217-d47f-415b-99ba-145e49fda104', 'e89405bc-b773-486f-8967-ad4a16b9dc7d'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:45:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-e16048e5-8c4a-4540-ad32-51c750935a53 tempest-VolumesAdminNegativeTest-431650060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:45:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-e16048e5-8c4a-4540-ad32-51c750935a53 tempest-VolumesAdminNegativeTest-431650060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:45:07 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-e16048e5-8c4a-4540-ad32-51c750935a53 tempest-VolumesAdminNegativeTest-431650060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:45:07 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-e16048e5-8c4a-4540-ad32-51c750935a53 tempest-VolumesAdminNegativeTest-431650060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:45:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-e16048e5-8c4a-4540-ad32-51c750935a53 tempest-VolumesAdminNegativeTest-431650060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:45:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e16048e5-8c4a-4540-ad32-51c750935a53 tempest-VolumesAdminNegativeTest-431650060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:07 devstack sudo[83481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:45:07 devstack sudo[83481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:08 devstack sudo[83481]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e16048e5-8c4a-4540-ad32-51c750935a53 tempest-VolumesAdminNegativeTest-431650060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 1.078s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:08 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-e16048e5-8c4a-4540-ad32-51c750935a53 tempest-VolumesAdminNegativeTest-431650060 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:45:08 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-e16048e5-8c4a-4540-ad32-51c750935a53 tempest-VolumesAdminNegativeTest-431650060 None] Deleted volume successfully. Apr 24 13:45:08 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e16048e5-8c4a-4540-ad32-51c750935a53 tempest-VolumesAdminNegativeTest-431650060 None] Lock "cinder-925d0675-3012-494b-9d27-0ed6b75cd440-delete_volume" released by "delete_volume" :: held 3.998s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:45:10 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-911c86f8-8b82-4901-9b4e-3f18636cfb11 tempest-DeleteServersTestJSON-259405003 None] Acquiring lock "cinder-b77d1676-813c-489f-85e9-17d24105bbf9-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:45:10 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-1fb07036-bbed-448e-9def-f4a24c760a8c tempest-GroupsTest-715821669 None] Group tempest-Group1-906825850: creating Apr 24 13:45:11 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-911c86f8-8b82-4901-9b4e-3f18636cfb11 tempest-DeleteServersTestJSON-259405003 None] Lock "cinder-b77d1676-813c-489f-85e9-17d24105bbf9-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:45:11 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-1fb07036-bbed-448e-9def-f4a24c760a8c tempest-GroupsTest-715821669 None] Group tempest-Group1-906825850: created successfully Apr 24 13:45:11 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-1fb07036-bbed-448e-9def-f4a24c760a8c tempest-GroupsTest-715821669 None] Create group completed successfully. Apr 24 13:45:11 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-911c86f8-8b82-4901-9b4e-3f18636cfb11 tempest-DeleteServersTestJSON-259405003 None] Acquiring lock "cinder-quobyte-b77d1676-813c-489f-85e9-17d24105bbf9" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:45:11 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-911c86f8-8b82-4901-9b4e-3f18636cfb11 tempest-DeleteServersTestJSON-259405003 None] Lock "cinder-quobyte-b77d1676-813c-489f-85e9-17d24105bbf9" acquired by "delete_volume" :: waited 0.018s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:45:11 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[1874a950-34ec-4627-8ad2-87dba95c3e2c]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:45:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-911c86f8-8b82-4901-9b4e-3f18636cfb11 tempest-DeleteServersTestJSON-259405003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b77d1676-813c-489f-85e9-17d24105bbf9 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:11 devstack sudo[83539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b77d1676-813c-489f-85e9-17d24105bbf9 Apr 24 13:45:11 devstack sudo[83539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:11 devstack sudo[83539]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-911c86f8-8b82-4901-9b4e-3f18636cfb11 tempest-DeleteServersTestJSON-259405003 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b77d1676-813c-489f-85e9-17d24105bbf9" returned: 0 in 0.742s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-911c86f8-8b82-4901-9b4e-3f18636cfb11 tempest-DeleteServersTestJSON-259405003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b77d1676-813c-489f-85e9-17d24105bbf9 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:11 devstack sudo[83547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b77d1676-813c-489f-85e9-17d24105bbf9 Apr 24 13:45:11 devstack sudo[83547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:12 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-5af69896-d041-4a62-8c22-e350f7fd9619 tempest-GroupSnapshotsTest-1762123974 None] Group tempest-GroupSnapshotsTest-Group-986980431: creating Apr 24 13:45:12 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-5af69896-d041-4a62-8c22-e350f7fd9619 tempest-GroupSnapshotsTest-1762123974 None] Group tempest-GroupSnapshotsTest-Group-986980431: created successfully Apr 24 13:45:12 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-5af69896-d041-4a62-8c22-e350f7fd9619 tempest-GroupSnapshotsTest-1762123974 None] Create group completed successfully. Apr 24 13:45:12 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-6da73ede-af3d-4b2b-bb2e-6f7359ea9242 tempest-GroupsTest-715821669 None] Group tempest-Group2-534643297: creating Apr 24 13:45:12 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-6da73ede-af3d-4b2b-bb2e-6f7359ea9242 tempest-GroupsTest-715821669 None] Group tempest-Group2-534643297: created successfully Apr 24 13:45:12 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-6da73ede-af3d-4b2b-bb2e-6f7359ea9242 tempest-GroupsTest-715821669 None] Create group completed successfully. Apr 24 13:45:12 devstack sudo[83547]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-911c86f8-8b82-4901-9b4e-3f18636cfb11 tempest-DeleteServersTestJSON-259405003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b77d1676-813c-489f-85e9-17d24105bbf9" returned: 0 in 0.808s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:12 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-911c86f8-8b82-4901-9b4e-3f18636cfb11 tempest-DeleteServersTestJSON-259405003 None] Lock "cinder-quobyte-b77d1676-813c-489f-85e9-17d24105bbf9" released by "delete_volume" :: held 1.597s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:45:12 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-911c86f8-8b82-4901-9b4e-3f18636cfb11 tempest-DeleteServersTestJSON-259405003 None] Created reservations ['50fa6f27-6fca-4431-bb7f-b95386e50009', '81ecd77f-54a4-45c3-92a4-a2f220476c96', '475d3b3e-90c6-4ea1-b6d1-84fc9c4008fc', 'ec3d9d45-5603-47dd-b3a7-55126f3d67a1'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:45:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-911c86f8-8b82-4901-9b4e-3f18636cfb11 tempest-DeleteServersTestJSON-259405003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:45:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-911c86f8-8b82-4901-9b4e-3f18636cfb11 tempest-DeleteServersTestJSON-259405003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:45:12 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-911c86f8-8b82-4901-9b4e-3f18636cfb11 tempest-DeleteServersTestJSON-259405003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:45:12 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-911c86f8-8b82-4901-9b4e-3f18636cfb11 tempest-DeleteServersTestJSON-259405003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:45:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-911c86f8-8b82-4901-9b4e-3f18636cfb11 tempest-DeleteServersTestJSON-259405003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:45:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-911c86f8-8b82-4901-9b4e-3f18636cfb11 tempest-DeleteServersTestJSON-259405003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:12 devstack sudo[83586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:45:12 devstack sudo[83586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:13 devstack sudo[83586]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-911c86f8-8b82-4901-9b4e-3f18636cfb11 tempest-DeleteServersTestJSON-259405003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.461s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:13 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-911c86f8-8b82-4901-9b4e-3f18636cfb11 tempest-DeleteServersTestJSON-259405003 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:45:13 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-911c86f8-8b82-4901-9b4e-3f18636cfb11 tempest-DeleteServersTestJSON-259405003 None] Deleted volume successfully. Apr 24 13:45:13 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-911c86f8-8b82-4901-9b4e-3f18636cfb11 tempest-DeleteServersTestJSON-259405003 None] Lock "cinder-b77d1676-813c-489f-85e9-17d24105bbf9-delete_volume" released by "delete_volume" :: held 2.308s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:45:14 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa156200-376d-46f6-8747-05105a9687fb tempest-GroupSnapshotsTest-1762123974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:45:14 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aa156200-376d-46f6-8747-05105a9687fb tempest-GroupSnapshotsTest-1762123974 None] Flow 'volume_create_manager' (b5be11bc-7c6d-41ed-b163-aaed8a9bd205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:45:14 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aa156200-376d-46f6-8747-05105a9687fb tempest-GroupSnapshotsTest-1762123974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f61644bd-ca8c-4530-9416-6f9206cefb82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:45:14 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aa156200-376d-46f6-8747-05105a9687fb tempest-GroupSnapshotsTest-1762123974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f61644bd-ca8c-4530-9416-6f9206cefb82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1009637097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=045c2c4b-c1a7-4c0b-b7cd-c014794ea11c,host='devstack@QuobyteHD#QuobyteHD',id=bf11f7bc-cbf7-4f59-a468-869a5579a17a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4246a8fe8dcd4b2e9ca8333916bc2f43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:45:14Z,use_quota=True,user_id='d088ccb065cb430db99c689f055c7437',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a4ba980-9ad7-480f-b9c6-88a8711de364),volume_type_id=2a4ba980-9ad7-480f-b9c6-88a8711de364)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:45:14 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aa156200-376d-46f6-8747-05105a9687fb tempest-GroupSnapshotsTest-1762123974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (026ad3ff-1e6a-4482-9217-ddba149aa485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:45:14 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aa156200-376d-46f6-8747-05105a9687fb tempest-GroupSnapshotsTest-1762123974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (026ad3ff-1e6a-4482-9217-ddba149aa485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:45:14 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aa156200-376d-46f6-8747-05105a9687fb tempest-GroupSnapshotsTest-1762123974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (896f66ca-cfa6-4c91-a578-0a471fdbe0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:45:14 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aa156200-376d-46f6-8747-05105a9687fb tempest-GroupSnapshotsTest-1762123974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (896f66ca-cfa6-4c91-a578-0a471fdbe0df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf11f7bc-cbf7-4f59-a468-869a5579a17a', 'volume_name': 'volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:45:14 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aa156200-376d-46f6-8747-05105a9687fb tempest-GroupSnapshotsTest-1762123974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ba219be-fc97-4326-8eb1-a202161f74b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:45:14 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aa156200-376d-46f6-8747-05105a9687fb tempest-GroupSnapshotsTest-1762123974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ba219be-fc97-4326-8eb1-a202161f74b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:45:14 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aa156200-376d-46f6-8747-05105a9687fb tempest-GroupSnapshotsTest-1762123974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78cdba34-7d4d-4afd-9180-20e6c66c6fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:45:14 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-aa156200-376d-46f6-8747-05105a9687fb tempest-GroupSnapshotsTest-1762123974 None] Volume bf11f7bc-cbf7-4f59-a468-869a5579a17a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a', 'volume_size': 1} Apr 24 13:45:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-aa156200-376d-46f6-8747-05105a9687fb tempest-GroupSnapshotsTest-1762123974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:45:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-aa156200-376d-46f6-8747-05105a9687fb tempest-GroupSnapshotsTest-1762123974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:45:14 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-aa156200-376d-46f6-8747-05105a9687fb tempest-GroupSnapshotsTest-1762123974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=045c2c4b-c1a7-4c0b-b7cd-c014794ea11c,created_at=2026-04-24T11:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1009637097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=045c2c4b-c1a7-4c0b-b7cd-c014794ea11c,host='devstack@QuobyteHD#QuobyteHD',id=bf11f7bc-cbf7-4f59-a468-869a5579a17a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4246a8fe8dcd4b2e9ca8333916bc2f43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:45:14Z,use_quota=True,user_id='d088ccb065cb430db99c689f055c7437',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a4ba980-9ad7-480f-b9c6-88a8711de364),volume_type_id=2a4ba980-9ad7-480f-b9c6-88a8711de364)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:45:14 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-aa156200-376d-46f6-8747-05105a9687fb tempest-GroupSnapshotsTest-1762123974 None] Creating volume bf11f7bc-cbf7-4f59-a468-869a5579a17a {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:45:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-aa156200-376d-46f6-8747-05105a9687fb tempest-GroupSnapshotsTest-1762123974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:45:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-aa156200-376d-46f6-8747-05105a9687fb tempest-GroupSnapshotsTest-1762123974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:45:14 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-aa156200-376d-46f6-8747-05105a9687fb tempest-GroupSnapshotsTest-1762123974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:45:14 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-aa156200-376d-46f6-8747-05105a9687fb tempest-GroupSnapshotsTest-1762123974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:45:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-aa156200-376d-46f6-8747-05105a9687fb tempest-GroupSnapshotsTest-1762123974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:45:14 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-aa156200-376d-46f6-8747-05105a9687fb tempest-GroupSnapshotsTest-1762123974 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:45:14 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-aa156200-376d-46f6-8747-05105a9687fb tempest-GroupSnapshotsTest-1762123974 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:45:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-aa156200-376d-46f6-8747-05105a9687fb tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:14 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-905ca23e-0085-449d-be71-8d1318125585 tempest-GroupsTest-715821669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:45:14 devstack sudo[83593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a 1073741824 Apr 24 13:45:14 devstack sudo[83593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:14 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-905ca23e-0085-449d-be71-8d1318125585 tempest-GroupsTest-715821669 None] Flow 'volume_create_manager' (078d0636-94d1-4793-8a18-c326ef86b7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:45:14 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-905ca23e-0085-449d-be71-8d1318125585 tempest-GroupsTest-715821669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c86bde55-5460-484f-aff3-ba18d9ea36f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:45:14 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-905ca23e-0085-449d-be71-8d1318125585 tempest-GroupsTest-715821669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c86bde55-5460-484f-aff3-ba18d9ea36f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-362646757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8803117b-7114-40d2-849f-3173ed51f2b9,host='devstack@QuobyteHD#QuobyteHD',id=13fc49e7-9521-4e9b-988d-3ccc068f25d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f74a84987ff4d859a41a1a2cb60f968',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:45:14Z,use_quota=True,user_id='2c05fe363d724c79ac8105eee4b3a592',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc660cbe-b733-44c8-b3f9-47692816c326),volume_type_id=cc660cbe-b733-44c8-b3f9-47692816c326)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:45:14 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-905ca23e-0085-449d-be71-8d1318125585 tempest-GroupsTest-715821669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7a98b76-1a7f-4576-86bf-d33dae7592cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:45:14 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-905ca23e-0085-449d-be71-8d1318125585 tempest-GroupsTest-715821669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7a98b76-1a7f-4576-86bf-d33dae7592cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:45:14 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-905ca23e-0085-449d-be71-8d1318125585 tempest-GroupsTest-715821669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b01bc1c9-0b5f-499a-9929-210ad2f139e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:45:14 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-905ca23e-0085-449d-be71-8d1318125585 tempest-GroupsTest-715821669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b01bc1c9-0b5f-499a-9929-210ad2f139e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13fc49e7-9521-4e9b-988d-3ccc068f25d9', 'volume_name': 'volume-13fc49e7-9521-4e9b-988d-3ccc068f25d9', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:45:14 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-905ca23e-0085-449d-be71-8d1318125585 tempest-GroupsTest-715821669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b49bfcc5-a408-459d-9c90-83860b9c4c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:45:14 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-905ca23e-0085-449d-be71-8d1318125585 tempest-GroupsTest-715821669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b49bfcc5-a408-459d-9c90-83860b9c4c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:45:14 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-905ca23e-0085-449d-be71-8d1318125585 tempest-GroupsTest-715821669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e61cd0e-5158-4854-9c23-ab3e28a4fe71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:45:14 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-905ca23e-0085-449d-be71-8d1318125585 tempest-GroupsTest-715821669 None] Volume 13fc49e7-9521-4e9b-988d-3ccc068f25d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13fc49e7-9521-4e9b-988d-3ccc068f25d9', 'volume_size': 1} Apr 24 13:45:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-905ca23e-0085-449d-be71-8d1318125585 tempest-GroupsTest-715821669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:45:15 devstack sudo[83593]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-aa156200-376d-46f6-8747-05105a9687fb tempest-GroupSnapshotsTest-1762123974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a 1073741824" returned: 0 in 0.694s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-aa156200-376d-46f6-8747-05105a9687fb tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:15 devstack sudo[83598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a Apr 24 13:45:15 devstack sudo[83598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:15 devstack sudo[83598]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-aa156200-376d-46f6-8747-05105a9687fb tempest-GroupSnapshotsTest-1762123974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a" returned: 0 in 0.694s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:15 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-aa156200-376d-46f6-8747-05105a9687fb tempest-GroupSnapshotsTest-1762123974 None] <== create_volume: return (1445ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:45:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-aa156200-376d-46f6-8747-05105a9687fb tempest-GroupSnapshotsTest-1762123974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.447s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:45:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-905ca23e-0085-449d-be71-8d1318125585 tempest-GroupsTest-715821669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.350s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:45:15 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-905ca23e-0085-449d-be71-8d1318125585 tempest-GroupsTest-715821669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8803117b-7114-40d2-849f-3173ed51f2b9,created_at=2026-04-24T11:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-362646757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8803117b-7114-40d2-849f-3173ed51f2b9,host='devstack@QuobyteHD#QuobyteHD',id=13fc49e7-9521-4e9b-988d-3ccc068f25d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f74a84987ff4d859a41a1a2cb60f968',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:45:14Z,use_quota=True,user_id='2c05fe363d724c79ac8105eee4b3a592',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc660cbe-b733-44c8-b3f9-47692816c326),volume_type_id=cc660cbe-b733-44c8-b3f9-47692816c326)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:45:15 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-905ca23e-0085-449d-be71-8d1318125585 tempest-GroupsTest-715821669 None] Creating volume 13fc49e7-9521-4e9b-988d-3ccc068f25d9 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:45:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-905ca23e-0085-449d-be71-8d1318125585 tempest-GroupsTest-715821669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:45:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-905ca23e-0085-449d-be71-8d1318125585 tempest-GroupsTest-715821669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:45:15 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-905ca23e-0085-449d-be71-8d1318125585 tempest-GroupsTest-715821669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:45:15 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-905ca23e-0085-449d-be71-8d1318125585 tempest-GroupsTest-715821669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:45:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-905ca23e-0085-449d-be71-8d1318125585 tempest-GroupsTest-715821669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:45:15 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-905ca23e-0085-449d-be71-8d1318125585 tempest-GroupsTest-715821669 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:45:15 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-905ca23e-0085-449d-be71-8d1318125585 tempest-GroupsTest-715821669 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:45:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-905ca23e-0085-449d-be71-8d1318125585 tempest-GroupsTest-715821669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-13fc49e7-9521-4e9b-988d-3ccc068f25d9 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:15 devstack sudo[83603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-13fc49e7-9521-4e9b-988d-3ccc068f25d9 1073741824 Apr 24 13:45:15 devstack sudo[83603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:15 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aa156200-376d-46f6-8747-05105a9687fb tempest-GroupSnapshotsTest-1762123974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78cdba34-7d4d-4afd-9180-20e6c66c6fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:45:15 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aa156200-376d-46f6-8747-05105a9687fb tempest-GroupSnapshotsTest-1762123974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4da3f6c-5121-46b8-9d00-d6659d9a1c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:45:15 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-aa156200-376d-46f6-8747-05105a9687fb tempest-GroupSnapshotsTest-1762123974 None] Volume volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a (bf11f7bc-cbf7-4f59-a468-869a5579a17a): created successfully Apr 24 13:45:15 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aa156200-376d-46f6-8747-05105a9687fb tempest-GroupSnapshotsTest-1762123974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4da3f6c-5121-46b8-9d00-d6659d9a1c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:45:15 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aa156200-376d-46f6-8747-05105a9687fb tempest-GroupSnapshotsTest-1762123974 None] Flow 'volume_create_manager' (b5be11bc-7c6d-41ed-b163-aaed8a9bd205) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:45:15 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-aa156200-376d-46f6-8747-05105a9687fb tempest-GroupSnapshotsTest-1762123974 None] Created volume successfully. Apr 24 13:45:16 devstack sudo[83603]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:16 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-905ca23e-0085-449d-be71-8d1318125585 tempest-GroupsTest-715821669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-13fc49e7-9521-4e9b-988d-3ccc068f25d9 1073741824" returned: 0 in 0.806s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:16 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-905ca23e-0085-449d-be71-8d1318125585 tempest-GroupsTest-715821669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-13fc49e7-9521-4e9b-988d-3ccc068f25d9 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:16 devstack sudo[83608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-13fc49e7-9521-4e9b-988d-3ccc068f25d9 Apr 24 13:45:16 devstack sudo[83608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:16 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-ee2c46d1-fc2e-4978-a78c-ef9c0b454512 tempest-GroupSnapshotsTest-1762123974 None] GroupSnapshot 2f8d7dff-ed9e-487c-bd21-971b3aef0a00: creating. Apr 24 13:45:16 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-ee2c46d1-fc2e-4978-a78c-ef9c0b454512 tempest-GroupSnapshotsTest-1762123974 None] Group snapshot 2f8d7dff-ed9e-487c-bd21-971b3aef0a00: creating. {{(pid=82046) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 24 13:45:16 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-ee2c46d1-fc2e-4978-a78c-ef9c0b454512 tempest-GroupSnapshotsTest-1762123974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:45:17 devstack sudo[83608]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-905ca23e-0085-449d-be71-8d1318125585 tempest-GroupsTest-715821669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-13fc49e7-9521-4e9b-988d-3ccc068f25d9" returned: 0 in 0.703s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:17 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-905ca23e-0085-449d-be71-8d1318125585 tempest-GroupsTest-715821669 None] <== create_volume: return (1571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:45:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-905ca23e-0085-449d-be71-8d1318125585 tempest-GroupsTest-715821669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.574s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:45:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-ee2c46d1-fc2e-4978-a78c-ef9c0b454512 tempest-GroupSnapshotsTest-1762123974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.388s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:45:17 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-ee2c46d1-fc2e-4978-a78c-ef9c0b454512 tempest-GroupSnapshotsTest-1762123974 None] Creating offline snapshot 9a3df598-a61a-4dee-9659-fac01ef8eb66 of volume bf11f7bc-cbf7-4f59-a468-869a5579a17a {{(pid=82046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 13:45:17 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-905ca23e-0085-449d-be71-8d1318125585 tempest-GroupsTest-715821669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e61cd0e-5158-4854-9c23-ab3e28a4fe71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13fc49e7-9521-4e9b-988d-3ccc068f25d9', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:45:17 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-905ca23e-0085-449d-be71-8d1318125585 tempest-GroupsTest-715821669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e965601b-72f9-4759-91ae-f564bd1becc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:45:17 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[489fb8d4-9fe0-4f57-bb18-7f3d053f7880]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:45:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ee2c46d1-fc2e-4978-a78c-ef9c0b454512 tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:17 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-905ca23e-0085-449d-be71-8d1318125585 tempest-GroupsTest-715821669 None] Volume volume-13fc49e7-9521-4e9b-988d-3ccc068f25d9 (13fc49e7-9521-4e9b-988d-3ccc068f25d9): created successfully Apr 24 13:45:17 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-905ca23e-0085-449d-be71-8d1318125585 tempest-GroupsTest-715821669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e965601b-72f9-4759-91ae-f564bd1becc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:45:17 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-905ca23e-0085-449d-be71-8d1318125585 tempest-GroupsTest-715821669 None] Flow 'volume_create_manager' (078d0636-94d1-4793-8a18-c326ef86b7fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:45:17 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-905ca23e-0085-449d-be71-8d1318125585 tempest-GroupsTest-715821669 None] Created volume successfully. Apr 24 13:45:17 devstack sudo[83611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a Apr 24 13:45:17 devstack sudo[83611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:18 devstack sudo[83611]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:18 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ee2c46d1-fc2e-4978-a78c-ef9c0b454512 tempest-GroupSnapshotsTest-1762123974 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a" returned: 0 in 0.861s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:18 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ee2c46d1-fc2e-4978-a78c-ef9c0b454512 tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a.9a3df598-a61a-4dee-9659-fac01ef8eb66 1G {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:18 devstack sudo[83619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a.9a3df598-a61a-4dee-9659-fac01ef8eb66 1G Apr 24 13:45:18 devstack sudo[83619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:19 devstack sudo[83619]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ee2c46d1-fc2e-4978-a78c-ef9c0b454512 tempest-GroupSnapshotsTest-1762123974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a.9a3df598-a61a-4dee-9659-fac01ef8eb66 1G" returned: 0 in 0.879s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ee2c46d1-fc2e-4978-a78c-ef9c0b454512 tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a.9a3df598-a61a-4dee-9659-fac01ef8eb66 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:19 devstack sudo[83624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a.9a3df598-a61a-4dee-9659-fac01ef8eb66 Apr 24 13:45:19 devstack sudo[83624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:19 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-bd85c1a4-d141-45f4-8c24-3deee750144e tempest-GroupsTest-715821669 None] Acquiring lock "cinder-quobyte-13fc49e7-9521-4e9b-988d-3ccc068f25d9" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:45:19 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-bd85c1a4-d141-45f4-8c24-3deee750144e tempest-GroupsTest-715821669 None] Lock "cinder-quobyte-13fc49e7-9521-4e9b-988d-3ccc068f25d9" acquired by "delete_volume" :: waited 0.019s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:45:19 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[85bc7425-8bc8-4234-9a68-e51d8fc8153d]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:45:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bd85c1a4-d141-45f4-8c24-3deee750144e tempest-GroupsTest-715821669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-13fc49e7-9521-4e9b-988d-3ccc068f25d9 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:19 devstack sudo[83624]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ee2c46d1-fc2e-4978-a78c-ef9c0b454512 tempest-GroupSnapshotsTest-1762123974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a.9a3df598-a61a-4dee-9659-fac01ef8eb66" returned: 0 in 0.700s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:19 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-ee2c46d1-fc2e-4978-a78c-ef9c0b454512 tempest-GroupSnapshotsTest-1762123974 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a.9a3df598-a61a-4dee-9659-fac01ef8eb66 is being set with open permissions: ugo+rw: NotImplementedError Apr 24 13:45:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ee2c46d1-fc2e-4978-a78c-ef9c0b454512 tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a.9a3df598-a61a-4dee-9659-fac01ef8eb66 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:19 devstack sudo[83630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a.9a3df598-a61a-4dee-9659-fac01ef8eb66 Apr 24 13:45:19 devstack sudo[83630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:19 devstack sudo[83629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-13fc49e7-9521-4e9b-988d-3ccc068f25d9 Apr 24 13:45:19 devstack sudo[83629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:20 devstack sudo[83629]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bd85c1a4-d141-45f4-8c24-3deee750144e tempest-GroupsTest-715821669 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-13fc49e7-9521-4e9b-988d-3ccc068f25d9" returned: 0 in 0.782s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bd85c1a4-d141-45f4-8c24-3deee750144e tempest-GroupsTest-715821669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-13fc49e7-9521-4e9b-988d-3ccc068f25d9 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:20 devstack sudo[83637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-13fc49e7-9521-4e9b-988d-3ccc068f25d9 Apr 24 13:45:20 devstack sudo[83637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:20 devstack sudo[83630]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ee2c46d1-fc2e-4978-a78c-ef9c0b454512 tempest-GroupSnapshotsTest-1762123974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a.9a3df598-a61a-4dee-9659-fac01ef8eb66" returned: 0 in 0.812s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ee2c46d1-fc2e-4978-a78c-ef9c0b454512 tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:20 devstack sudo[83639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a.info Apr 24 13:45:20 devstack sudo[83639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:21 devstack sudo[83637]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bd85c1a4-d141-45f4-8c24-3deee750144e tempest-GroupsTest-715821669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-13fc49e7-9521-4e9b-988d-3ccc068f25d9" returned: 0 in 0.768s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:21 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-bd85c1a4-d141-45f4-8c24-3deee750144e tempest-GroupsTest-715821669 None] Lock "cinder-quobyte-13fc49e7-9521-4e9b-988d-3ccc068f25d9" released by "delete_volume" :: held 1.608s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:45:21 devstack sudo[83639]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:21 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-bd85c1a4-d141-45f4-8c24-3deee750144e tempest-GroupsTest-715821669 None] Created reservations ['8a1a486c-b61f-4f74-96e9-3185ad83de60'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:45:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ee2c46d1-fc2e-4978-a78c-ef9c0b454512 tempest-GroupSnapshotsTest-1762123974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a.info" returned: 0 in 0.774s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:21 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-ee2c46d1-fc2e-4978-a78c-ef9c0b454512 tempest-GroupSnapshotsTest-1762123974 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a.info is being set with open permissions: ugo+rw: NotImplementedError Apr 24 13:45:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ee2c46d1-fc2e-4978-a78c-ef9c0b454512 tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:21 devstack sudo[83644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a.info Apr 24 13:45:21 devstack sudo[83644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:21 devstack cinder-volume[82046]: WARNING cinder.quota [None req-bd85c1a4-d141-45f4-8c24-3deee750144e tempest-GroupsTest-715821669 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2114972354 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2114972354, it is now deprecated. Please use the default quota class for default quota. Apr 24 13:45:21 devstack cinder-volume[82046]: WARNING cinder.quota [None req-bd85c1a4-d141-45f4-8c24-3deee750144e tempest-GroupsTest-715821669 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2114972354 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2114972354, it is now deprecated. Please use the default quota class for default quota. Apr 24 13:45:21 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-bd85c1a4-d141-45f4-8c24-3deee750144e tempest-GroupsTest-715821669 None] Created reservations ['b6a918f8-c004-49ef-8fd2-6bb684a6c3dd', 'a39d74fb-4506-43b6-a27e-2085adfe7f97', '3e460ecb-ac59-4ea6-b752-7fdc13cf7c16', '4f3b7e84-e2b3-4305-85a3-df6074d8b590'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:45:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-bd85c1a4-d141-45f4-8c24-3deee750144e tempest-GroupsTest-715821669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:45:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-bd85c1a4-d141-45f4-8c24-3deee750144e tempest-GroupsTest-715821669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:45:21 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-bd85c1a4-d141-45f4-8c24-3deee750144e tempest-GroupsTest-715821669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:45:21 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-bd85c1a4-d141-45f4-8c24-3deee750144e tempest-GroupsTest-715821669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:45:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-bd85c1a4-d141-45f4-8c24-3deee750144e tempest-GroupsTest-715821669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:45:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bd85c1a4-d141-45f4-8c24-3deee750144e tempest-GroupsTest-715821669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:21 devstack sudo[83646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:45:21 devstack sudo[83646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:22 devstack sudo[83644]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ee2c46d1-fc2e-4978-a78c-ef9c0b454512 tempest-GroupSnapshotsTest-1762123974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a.info" returned: 0 in 0.668s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-ee2c46d1-fc2e-4978-a78c-ef9c0b454512 tempest-GroupSnapshotsTest-1762123974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.817s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:45:22 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-ee2c46d1-fc2e-4978-a78c-ef9c0b454512 tempest-GroupSnapshotsTest-1762123974 None] group_snapshot 2f8d7dff-ed9e-487c-bd21-971b3aef0a00: created successfully Apr 24 13:45:22 devstack sudo[83646]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bd85c1a4-d141-45f4-8c24-3deee750144e tempest-GroupsTest-715821669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.744s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:22 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-bd85c1a4-d141-45f4-8c24-3deee750144e tempest-GroupsTest-715821669 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:45:22 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-bd85c1a4-d141-45f4-8c24-3deee750144e tempest-GroupsTest-715821669 None] Delete group completed successfully. Apr 24 13:45:22 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-bca4f302-7f1d-441e-bd9c-e45144217e22 tempest-GroupsTest-715821669 None] Created reservations ['6a2acb63-2797-4e88-80ce-d8508cb2988c'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:45:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-bca4f302-7f1d-441e-bd9c-e45144217e22 tempest-GroupsTest-715821669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:45:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-bca4f302-7f1d-441e-bd9c-e45144217e22 tempest-GroupsTest-715821669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:45:22 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-bca4f302-7f1d-441e-bd9c-e45144217e22 tempest-GroupsTest-715821669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:45:22 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-bca4f302-7f1d-441e-bd9c-e45144217e22 tempest-GroupsTest-715821669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:45:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-bca4f302-7f1d-441e-bd9c-e45144217e22 tempest-GroupsTest-715821669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:45:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bca4f302-7f1d-441e-bd9c-e45144217e22 tempest-GroupsTest-715821669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:22 devstack sudo[83650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:45:22 devstack sudo[83650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:23 devstack sudo[83650]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:23 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bca4f302-7f1d-441e-bd9c-e45144217e22 tempest-GroupsTest-715821669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.558s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:23 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-bca4f302-7f1d-441e-bd9c-e45144217e22 tempest-GroupsTest-715821669 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:45:23 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-bca4f302-7f1d-441e-bd9c-e45144217e22 tempest-GroupsTest-715821669 None] Delete group completed successfully. Apr 24 13:45:24 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-53743f24-e89c-4bcc-b9c8-aaebf031ad8e tempest-GroupsTest-715821669 None] Group tempest-GroupsTest-Group-189358362: creating Apr 24 13:45:24 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-53743f24-e89c-4bcc-b9c8-aaebf031ad8e tempest-GroupsTest-715821669 None] Group tempest-GroupsTest-Group-189358362: created successfully Apr 24 13:45:24 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-53743f24-e89c-4bcc-b9c8-aaebf031ad8e tempest-GroupsTest-715821669 None] Create group completed successfully. Apr 24 13:45:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-57e2d0a2-894f-40db-b44c-482257582323 tempest-GroupSnapshotsTest-1762123974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:45:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-57e2d0a2-894f-40db-b44c-482257582323 tempest-GroupSnapshotsTest-1762123974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:45:24 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-57e2d0a2-894f-40db-b44c-482257582323 tempest-GroupSnapshotsTest-1762123974 None] Acquiring lock "cinder-quobyte-9a3df598-a61a-4dee-9659-fac01ef8eb66-7062514d-cd5c-4462-aad1-29bf66d91465" by "_create_volume_from_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:45:24 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-57e2d0a2-894f-40db-b44c-482257582323 tempest-GroupSnapshotsTest-1762123974 None] Lock "cinder-quobyte-9a3df598-a61a-4dee-9659-fac01ef8eb66-7062514d-cd5c-4462-aad1-29bf66d91465" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:45:24 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-57e2d0a2-894f-40db-b44c-482257582323 tempest-GroupSnapshotsTest-1762123974 None] Creating volume 7062514d-cd5c-4462-aad1-29bf66d91465 from snapshot 9a3df598-a61a-4dee-9659-fac01ef8eb66 {{(pid=82046) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 13:45:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-57e2d0a2-894f-40db-b44c-482257582323 tempest-GroupSnapshotsTest-1762123974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:45:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-57e2d0a2-894f-40db-b44c-482257582323 tempest-GroupSnapshotsTest-1762123974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:45:24 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-57e2d0a2-894f-40db-b44c-482257582323 tempest-GroupSnapshotsTest-1762123974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:45:24 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-57e2d0a2-894f-40db-b44c-482257582323 tempest-GroupSnapshotsTest-1762123974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:45:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-57e2d0a2-894f-40db-b44c-482257582323 tempest-GroupSnapshotsTest-1762123974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:45:24 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-57e2d0a2-894f-40db-b44c-482257582323 tempest-GroupSnapshotsTest-1762123974 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:45:24 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-57e2d0a2-894f-40db-b44c-482257582323 tempest-GroupSnapshotsTest-1762123974 None] Acquiring lock "cinder-quobyte-7062514d-cd5c-4462-aad1-29bf66d91465" by "_copy_volume_from_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:45:24 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-57e2d0a2-894f-40db-b44c-482257582323 tempest-GroupSnapshotsTest-1762123974 None] Lock "cinder-quobyte-7062514d-cd5c-4462-aad1-29bf66d91465" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:45:24 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-57e2d0a2-894f-40db-b44c-482257582323 tempest-GroupSnapshotsTest-1762123974 None] snapshot: 9a3df598-a61a-4dee-9659-fac01ef8eb66, volume: 7062514d-cd5c-4462-aad1-29bf66d91465, {{(pid=82046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 13:45:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-57e2d0a2-894f-40db-b44c-482257582323 tempest-GroupSnapshotsTest-1762123974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:45:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-57e2d0a2-894f-40db-b44c-482257582323 tempest-GroupSnapshotsTest-1762123974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:45:24 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-57e2d0a2-894f-40db-b44c-482257582323 tempest-GroupSnapshotsTest-1762123974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:45:24 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-57e2d0a2-894f-40db-b44c-482257582323 tempest-GroupSnapshotsTest-1762123974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:45:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-57e2d0a2-894f-40db-b44c-482257582323 tempest-GroupSnapshotsTest-1762123974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:45:24 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9071bac-a9c8-4cfb-abc9-f5f018a24e39]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:45:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-57e2d0a2-894f-40db-b44c-482257582323 tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a.9a3df598-a61a-4dee-9659-fac01ef8eb66 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:24 devstack sudo[83655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a.9a3df598-a61a-4dee-9659-fac01ef8eb66 Apr 24 13:45:24 devstack sudo[83655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:25 devstack sudo[83655]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:25 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-57e2d0a2-894f-40db-b44c-482257582323 tempest-GroupSnapshotsTest-1762123974 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a.9a3df598-a61a-4dee-9659-fac01ef8eb66" returned: 0 in 0.933s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:25 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-57e2d0a2-894f-40db-b44c-482257582323 tempest-GroupSnapshotsTest-1762123974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:45:25 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-57e2d0a2-894f-40db-b44c-482257582323 tempest-GroupSnapshotsTest-1762123974 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a {{(pid=82046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 13:45:25 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-57e2d0a2-894f-40db-b44c-482257582323 tempest-GroupSnapshotsTest-1762123974 None] Creating direct copy from snapshot {{(pid=82046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 13:45:25 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fc2782-7e21-418f-bd53-9fc56f496417]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:45:25 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-57e2d0a2-894f-40db-b44c-482257582323 tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:25 devstack sudo[83662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a Apr 24 13:45:25 devstack sudo[83662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:26 devstack cinder-volume[82046]: DEBUG dbcounter [-] [82046] Writing DB stats cinder:SELECT=81,cinder:UPDATE=68,cinder:INSERT=22,cinder:DELETE=7 {{(pid=82046) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 13:45:26 devstack cinder-volume[82046]: DEBUG dbcounter [-] [82046] Writing DB stats cinder:UPDATE=88,cinder:SELECT=73,cinder:INSERT=12,cinder:DELETE=4 {{(pid=82046) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 13:45:26 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c1205ef-9716-4b80-9076-8a58bf3658a9 tempest-GroupsTest-715821669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:45:26 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-7c1205ef-9716-4b80-9076-8a58bf3658a9 tempest-GroupsTest-715821669 None] Flow 'volume_create_manager' (8da7a8a5-213a-448f-a08d-22a984b21785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:45:26 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-7c1205ef-9716-4b80-9076-8a58bf3658a9 tempest-GroupsTest-715821669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d45f0fc7-8c47-42c6-94e2-e9108d2be124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:45:26 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-7c1205ef-9716-4b80-9076-8a58bf3658a9 tempest-GroupsTest-715821669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d45f0fc7-8c47-42c6-94e2-e9108d2be124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-562026180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2260c6a8-886b-40a5-b6ea-a3b8086588a0,host='devstack@QuobyteHD#QuobyteHD',id=4ac56d54-e05f-4d11-874d-df924a8af7ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f74a84987ff4d859a41a1a2cb60f968',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:45:26Z,use_quota=True,user_id='2c05fe363d724c79ac8105eee4b3a592',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0de85350-372e-44e5-bc5e-1f78acdc1a7f),volume_type_id=0de85350-372e-44e5-bc5e-1f78acdc1a7f)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:45:26 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-7c1205ef-9716-4b80-9076-8a58bf3658a9 tempest-GroupsTest-715821669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6421c9a0-26cf-4711-a607-0fe2daf22faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:45:26 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-7c1205ef-9716-4b80-9076-8a58bf3658a9 tempest-GroupsTest-715821669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6421c9a0-26cf-4711-a607-0fe2daf22faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:45:26 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-7c1205ef-9716-4b80-9076-8a58bf3658a9 tempest-GroupsTest-715821669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c73da58-33e3-461a-afb1-910ac2637df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:45:26 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-7c1205ef-9716-4b80-9076-8a58bf3658a9 tempest-GroupsTest-715821669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c73da58-33e3-461a-afb1-910ac2637df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ac56d54-e05f-4d11-874d-df924a8af7ee', 'volume_name': 'volume-4ac56d54-e05f-4d11-874d-df924a8af7ee', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:45:26 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-7c1205ef-9716-4b80-9076-8a58bf3658a9 tempest-GroupsTest-715821669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40387565-8192-4692-b104-4d4a752f7ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:45:26 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-7c1205ef-9716-4b80-9076-8a58bf3658a9 tempest-GroupsTest-715821669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40387565-8192-4692-b104-4d4a752f7ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:45:26 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-7c1205ef-9716-4b80-9076-8a58bf3658a9 tempest-GroupsTest-715821669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90ba9c65-6771-4c0c-9b27-5a6c7ba44446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:45:26 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-7c1205ef-9716-4b80-9076-8a58bf3658a9 tempest-GroupsTest-715821669 None] Volume 4ac56d54-e05f-4d11-874d-df924a8af7ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ac56d54-e05f-4d11-874d-df924a8af7ee', 'volume_size': 1} Apr 24 13:45:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-7c1205ef-9716-4b80-9076-8a58bf3658a9 tempest-GroupsTest-715821669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:45:26 devstack sudo[83662]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-57e2d0a2-894f-40db-b44c-482257582323 tempest-GroupSnapshotsTest-1762123974 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a" returned: 0 in 1.023s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:26 devstack cinder-volume[82046]: DEBUG cinder.utils [None req-57e2d0a2-894f-40db-b44c-482257582323 tempest-GroupSnapshotsTest-1762123974 None] Path /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7062514d-cd5c-4462-aad1-29bf66d91465 not found in is_blk_device check {{(pid=82046) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 13:45:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-57e2d0a2-894f-40db-b44c-482257582323 tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7062514d-cd5c-4462-aad1-29bf66d91465 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:26 devstack sudo[83669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7062514d-cd5c-4462-aad1-29bf66d91465 Apr 24 13:45:26 devstack sudo[83669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:34 devstack sudo[83669]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-57e2d0a2-894f-40db-b44c-482257582323 tempest-GroupSnapshotsTest-1762123974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7062514d-cd5c-4462-aad1-29bf66d91465" returned: 0 in 7.236s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:34 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8e3814-4d22-4e28-961c-e44456fa0077]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:45:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-57e2d0a2-894f-40db-b44c-482257582323 tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:34 devstack sudo[83698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a Apr 24 13:45:34 devstack sudo[83698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:35 devstack sudo[83698]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-57e2d0a2-894f-40db-b44c-482257582323 tempest-GroupSnapshotsTest-1762123974 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a" returned: 0 in 0.951s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:35 devstack cinder-volume[82046]: DEBUG cinder.image.image_utils [None req-57e2d0a2-894f-40db-b44c-482257582323 tempest-GroupSnapshotsTest-1762123974 None] Image conversion details: src /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a, size 1024.00 MB, duration 7.24 sec, destination /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7062514d-cd5c-4462-aad1-29bf66d91465 {{(pid=82046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 13:45:35 devstack cinder-volume[82046]: INFO cinder.image.image_utils [None req-57e2d0a2-894f-40db-b44c-482257582323 tempest-GroupSnapshotsTest-1762123974 None] Converted 1024.00 MB image at 141.49 MB/s Apr 24 13:45:35 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-57e2d0a2-894f-40db-b44c-482257582323 tempest-GroupSnapshotsTest-1762123974 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7062514d-cd5c-4462-aad1-29bf66d91465 is being set with open permissions: ugo+rw: NotImplementedError Apr 24 13:45:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-57e2d0a2-894f-40db-b44c-482257582323 tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7062514d-cd5c-4462-aad1-29bf66d91465 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:35 devstack sudo[83703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7062514d-cd5c-4462-aad1-29bf66d91465 Apr 24 13:45:35 devstack sudo[83703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:35 devstack sudo[83703]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-57e2d0a2-894f-40db-b44c-482257582323 tempest-GroupSnapshotsTest-1762123974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7062514d-cd5c-4462-aad1-29bf66d91465" returned: 0 in 0.587s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:35 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-57e2d0a2-894f-40db-b44c-482257582323 tempest-GroupSnapshotsTest-1762123974 None] Lock "cinder-quobyte-7062514d-cd5c-4462-aad1-29bf66d91465" released by "_copy_volume_from_snapshot" :: held 10.858s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:45:35 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-57e2d0a2-894f-40db-b44c-482257582323 tempest-GroupSnapshotsTest-1762123974 None] Lock "cinder-quobyte-9a3df598-a61a-4dee-9659-fac01ef8eb66-7062514d-cd5c-4462-aad1-29bf66d91465" released by "_create_volume_from_snapshot" :: held 10.899s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:45:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-57e2d0a2-894f-40db-b44c-482257582323 tempest-GroupSnapshotsTest-1762123974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.922s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:45:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-7c1205ef-9716-4b80-9076-8a58bf3658a9 tempest-GroupsTest-715821669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.201s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:45:35 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-7c1205ef-9716-4b80-9076-8a58bf3658a9 tempest-GroupsTest-715821669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2260c6a8-886b-40a5-b6ea-a3b8086588a0,created_at=2026-04-24T11:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-562026180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2260c6a8-886b-40a5-b6ea-a3b8086588a0,host='devstack@QuobyteHD#QuobyteHD',id=4ac56d54-e05f-4d11-874d-df924a8af7ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f74a84987ff4d859a41a1a2cb60f968',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:45:26Z,use_quota=True,user_id='2c05fe363d724c79ac8105eee4b3a592',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0de85350-372e-44e5-bc5e-1f78acdc1a7f),volume_type_id=0de85350-372e-44e5-bc5e-1f78acdc1a7f)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:45:35 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-7c1205ef-9716-4b80-9076-8a58bf3658a9 tempest-GroupsTest-715821669 None] Creating volume 4ac56d54-e05f-4d11-874d-df924a8af7ee {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:45:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-7c1205ef-9716-4b80-9076-8a58bf3658a9 tempest-GroupsTest-715821669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:45:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-7c1205ef-9716-4b80-9076-8a58bf3658a9 tempest-GroupsTest-715821669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:45:35 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-7c1205ef-9716-4b80-9076-8a58bf3658a9 tempest-GroupsTest-715821669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:45:35 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-7c1205ef-9716-4b80-9076-8a58bf3658a9 tempest-GroupsTest-715821669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:45:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-7c1205ef-9716-4b80-9076-8a58bf3658a9 tempest-GroupsTest-715821669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:45:35 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-7c1205ef-9716-4b80-9076-8a58bf3658a9 tempest-GroupsTest-715821669 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:45:35 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-7c1205ef-9716-4b80-9076-8a58bf3658a9 tempest-GroupsTest-715821669 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:45:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7c1205ef-9716-4b80-9076-8a58bf3658a9 tempest-GroupsTest-715821669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4ac56d54-e05f-4d11-874d-df924a8af7ee 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:35 devstack sudo[83707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4ac56d54-e05f-4d11-874d-df924a8af7ee 1073741824 Apr 24 13:45:35 devstack sudo[83707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:35 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-57e2d0a2-894f-40db-b44c-482257582323 tempest-GroupSnapshotsTest-1762123974 None] Create group from source-snapshot-2f8d7dff-ed9e-487c-bd21-971b3aef0a00 completed successfully. Apr 24 13:45:36 devstack sudo[83707]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7c1205ef-9716-4b80-9076-8a58bf3658a9 tempest-GroupsTest-715821669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4ac56d54-e05f-4d11-874d-df924a8af7ee 1073741824" returned: 0 in 0.825s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7c1205ef-9716-4b80-9076-8a58bf3658a9 tempest-GroupsTest-715821669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4ac56d54-e05f-4d11-874d-df924a8af7ee {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:36 devstack sudo[83712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4ac56d54-e05f-4d11-874d-df924a8af7ee Apr 24 13:45:36 devstack sudo[83712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:37 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b97bc760-2304-49f9-bff0-d601de923fe8 tempest-GroupSnapshotsTest-1762123974 None] Acquiring lock "cinder-quobyte-7062514d-cd5c-4462-aad1-29bf66d91465" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:45:37 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b97bc760-2304-49f9-bff0-d601de923fe8 tempest-GroupSnapshotsTest-1762123974 None] Lock "cinder-quobyte-7062514d-cd5c-4462-aad1-29bf66d91465" acquired by "delete_volume" :: waited 0.033s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:45:37 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8159c0-b717-446e-9c3a-dfeb6b7df06e]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:45:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b97bc760-2304-49f9-bff0-d601de923fe8 tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7062514d-cd5c-4462-aad1-29bf66d91465 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:37 devstack sudo[83712]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7c1205ef-9716-4b80-9076-8a58bf3658a9 tempest-GroupsTest-715821669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4ac56d54-e05f-4d11-874d-df924a8af7ee" returned: 0 in 0.830s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:37 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-7c1205ef-9716-4b80-9076-8a58bf3658a9 tempest-GroupsTest-715821669 None] <== create_volume: return (1708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:45:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-7c1205ef-9716-4b80-9076-8a58bf3658a9 tempest-GroupsTest-715821669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.713s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:45:37 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-7c1205ef-9716-4b80-9076-8a58bf3658a9 tempest-GroupsTest-715821669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90ba9c65-6771-4c0c-9b27-5a6c7ba44446) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ac56d54-e05f-4d11-874d-df924a8af7ee', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:45:37 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-7c1205ef-9716-4b80-9076-8a58bf3658a9 tempest-GroupsTest-715821669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bf0b556-69eb-45ca-979d-7905292ac16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:45:37 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-7c1205ef-9716-4b80-9076-8a58bf3658a9 tempest-GroupsTest-715821669 None] Volume volume-4ac56d54-e05f-4d11-874d-df924a8af7ee (4ac56d54-e05f-4d11-874d-df924a8af7ee): created successfully Apr 24 13:45:37 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-7c1205ef-9716-4b80-9076-8a58bf3658a9 tempest-GroupsTest-715821669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bf0b556-69eb-45ca-979d-7905292ac16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:45:37 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-7c1205ef-9716-4b80-9076-8a58bf3658a9 tempest-GroupsTest-715821669 None] Flow 'volume_create_manager' (8da7a8a5-213a-448f-a08d-22a984b21785) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:45:37 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-7c1205ef-9716-4b80-9076-8a58bf3658a9 tempest-GroupsTest-715821669 None] Created volume successfully. Apr 24 13:45:37 devstack sudo[83721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7062514d-cd5c-4462-aad1-29bf66d91465 Apr 24 13:45:37 devstack sudo[83721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:37 devstack cinder-volume[82046]: DEBUG oslo_service.periodic_task [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82046) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 13:45:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:45:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:45:37 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:45:37 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:45:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:45:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:37 devstack sudo[83726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:45:37 devstack sudo[83726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:37 devstack sudo[83721]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b97bc760-2304-49f9-bff0-d601de923fe8 tempest-GroupSnapshotsTest-1762123974 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7062514d-cd5c-4462-aad1-29bf66d91465" returned: 0 in 0.626s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b97bc760-2304-49f9-bff0-d601de923fe8 tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7062514d-cd5c-4462-aad1-29bf66d91465 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:38 devstack sudo[83728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7062514d-cd5c-4462-aad1-29bf66d91465 Apr 24 13:45:38 devstack sudo[83728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:38 devstack sudo[83728]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b97bc760-2304-49f9-bff0-d601de923fe8 tempest-GroupSnapshotsTest-1762123974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7062514d-cd5c-4462-aad1-29bf66d91465" returned: 0 in 0.770s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:38 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b97bc760-2304-49f9-bff0-d601de923fe8 tempest-GroupSnapshotsTest-1762123974 None] Lock "cinder-quobyte-7062514d-cd5c-4462-aad1-29bf66d91465" released by "delete_volume" :: held 1.462s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:45:38 devstack sudo[83726]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:38 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-b97bc760-2304-49f9-bff0-d601de923fe8 tempest-GroupSnapshotsTest-1762123974 None] Created reservations ['2afee871-ce47-4fb4-b6e4-a945824f644b'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:45:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.981s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:38 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:45:38 devstack cinder-volume[82046]: WARNING cinder.quota [None req-b97bc760-2304-49f9-bff0-d601de923fe8 tempest-GroupSnapshotsTest-1762123974 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-973891764 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-973891764, it is now deprecated. Please use the default quota class for default quota. Apr 24 13:45:38 devstack cinder-volume[82046]: WARNING cinder.quota [None req-b97bc760-2304-49f9-bff0-d601de923fe8 tempest-GroupSnapshotsTest-1762123974 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-973891764 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-973891764, it is now deprecated. Please use the default quota class for default quota. Apr 24 13:45:39 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-b97bc760-2304-49f9-bff0-d601de923fe8 tempest-GroupSnapshotsTest-1762123974 None] Created reservations ['d6dba6f7-62f4-4e9e-a426-ddc6e921defb', '6b094740-9716-48a3-933f-3c69ad19085b', '59e4cbeb-fbf5-4397-96cd-3f284fed2933', '5f280195-f0fa-495f-952a-f2ea5676b5e8'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:45:39 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cd3a74f-8a22-4272-a00c-03e8a84f095e tempest-GroupsTest-715821669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:45:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5cd3a74f-8a22-4272-a00c-03e8a84f095e tempest-GroupsTest-715821669 None] Flow 'volume_create_manager' (1a94aa70-2cd1-4c64-9b96-cb75ac2632ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:45:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5cd3a74f-8a22-4272-a00c-03e8a84f095e tempest-GroupsTest-715821669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1f43852-4d88-4d7e-8ee1-590d2d31894c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:45:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5cd3a74f-8a22-4272-a00c-03e8a84f095e tempest-GroupsTest-715821669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1f43852-4d88-4d7e-8ee1-590d2d31894c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:45:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-771527144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2260c6a8-886b-40a5-b6ea-a3b8086588a0,host='devstack@QuobyteHD#QuobyteHD',id=bcb49222-bf06-45d8-b6b5-92b40fa79f99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f74a84987ff4d859a41a1a2cb60f968',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:45:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:45:39Z,use_quota=True,user_id='2c05fe363d724c79ac8105eee4b3a592',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0de85350-372e-44e5-bc5e-1f78acdc1a7f),volume_type_id=0de85350-372e-44e5-bc5e-1f78acdc1a7f)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:45:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5cd3a74f-8a22-4272-a00c-03e8a84f095e tempest-GroupsTest-715821669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7edf8f2c-e2a2-498f-a2b1-bba1ddcf9c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:45:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5cd3a74f-8a22-4272-a00c-03e8a84f095e tempest-GroupsTest-715821669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7edf8f2c-e2a2-498f-a2b1-bba1ddcf9c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:45:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5cd3a74f-8a22-4272-a00c-03e8a84f095e tempest-GroupsTest-715821669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6d56e38-fd61-4b36-993f-13486e30a87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:45:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5cd3a74f-8a22-4272-a00c-03e8a84f095e tempest-GroupsTest-715821669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6d56e38-fd61-4b36-993f-13486e30a87b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcb49222-bf06-45d8-b6b5-92b40fa79f99', 'volume_name': 'volume-bcb49222-bf06-45d8-b6b5-92b40fa79f99', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:45:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5cd3a74f-8a22-4272-a00c-03e8a84f095e tempest-GroupsTest-715821669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b138cd9-605c-4dbd-823c-b6fae971d9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:45:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5cd3a74f-8a22-4272-a00c-03e8a84f095e tempest-GroupsTest-715821669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b138cd9-605c-4dbd-823c-b6fae971d9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:45:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5cd3a74f-8a22-4272-a00c-03e8a84f095e tempest-GroupsTest-715821669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50b870bb-8c67-4332-a5bc-913d3b393353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:45:39 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-5cd3a74f-8a22-4272-a00c-03e8a84f095e tempest-GroupsTest-715821669 None] Volume bcb49222-bf06-45d8-b6b5-92b40fa79f99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcb49222-bf06-45d8-b6b5-92b40fa79f99', 'volume_size': 1} Apr 24 13:45:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5cd3a74f-8a22-4272-a00c-03e8a84f095e tempest-GroupsTest-715821669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:45:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5cd3a74f-8a22-4272-a00c-03e8a84f095e tempest-GroupsTest-715821669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:45:39 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-5cd3a74f-8a22-4272-a00c-03e8a84f095e tempest-GroupsTest-715821669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2260c6a8-886b-40a5-b6ea-a3b8086588a0,created_at=2026-04-24T11:45:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-771527144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2260c6a8-886b-40a5-b6ea-a3b8086588a0,host='devstack@QuobyteHD#QuobyteHD',id=bcb49222-bf06-45d8-b6b5-92b40fa79f99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f74a84987ff4d859a41a1a2cb60f968',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:45:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:45:39Z,use_quota=True,user_id='2c05fe363d724c79ac8105eee4b3a592',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0de85350-372e-44e5-bc5e-1f78acdc1a7f),volume_type_id=0de85350-372e-44e5-bc5e-1f78acdc1a7f)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:45:39 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-5cd3a74f-8a22-4272-a00c-03e8a84f095e tempest-GroupsTest-715821669 None] Creating volume bcb49222-bf06-45d8-b6b5-92b40fa79f99 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:45:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5cd3a74f-8a22-4272-a00c-03e8a84f095e tempest-GroupsTest-715821669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:45:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5cd3a74f-8a22-4272-a00c-03e8a84f095e tempest-GroupsTest-715821669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:45:39 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-5cd3a74f-8a22-4272-a00c-03e8a84f095e tempest-GroupsTest-715821669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:45:39 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-5cd3a74f-8a22-4272-a00c-03e8a84f095e tempest-GroupsTest-715821669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:45:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5cd3a74f-8a22-4272-a00c-03e8a84f095e tempest-GroupsTest-715821669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:45:39 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-5cd3a74f-8a22-4272-a00c-03e8a84f095e tempest-GroupsTest-715821669 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:45:39 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-5cd3a74f-8a22-4272-a00c-03e8a84f095e tempest-GroupsTest-715821669 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:45:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5cd3a74f-8a22-4272-a00c-03e8a84f095e tempest-GroupsTest-715821669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bcb49222-bf06-45d8-b6b5-92b40fa79f99 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:39 devstack sudo[83735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bcb49222-bf06-45d8-b6b5-92b40fa79f99 1073741824 Apr 24 13:45:39 devstack sudo[83735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b97bc760-2304-49f9-bff0-d601de923fe8 tempest-GroupSnapshotsTest-1762123974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:45:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b97bc760-2304-49f9-bff0-d601de923fe8 tempest-GroupSnapshotsTest-1762123974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:45:39 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b97bc760-2304-49f9-bff0-d601de923fe8 tempest-GroupSnapshotsTest-1762123974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:45:39 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b97bc760-2304-49f9-bff0-d601de923fe8 tempest-GroupSnapshotsTest-1762123974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:45:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b97bc760-2304-49f9-bff0-d601de923fe8 tempest-GroupSnapshotsTest-1762123974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:45:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b97bc760-2304-49f9-bff0-d601de923fe8 tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:39 devstack sudo[83737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:45:39 devstack sudo[83737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:39 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-0e67adfe-6f52-4941-9f5e-97d15db0f5e1 tempest-GroupSnapshotsTest-1762123974 None] group_snapshot 2f8d7dff-ed9e-487c-bd21-971b3aef0a00: deleting Apr 24 13:45:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0e67adfe-6f52-4941-9f5e-97d15db0f5e1 tempest-GroupSnapshotsTest-1762123974 None] group_snapshot 2f8d7dff-ed9e-487c-bd21-971b3aef0a00: deleting {{(pid=82046) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 24 13:45:39 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-0e67adfe-6f52-4941-9f5e-97d15db0f5e1 tempest-GroupSnapshotsTest-1762123974 None] Acquiring lock "cinder-quobyte-bf11f7bc-cbf7-4f59-a468-869a5579a17a" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:45:39 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-0e67adfe-6f52-4941-9f5e-97d15db0f5e1 tempest-GroupSnapshotsTest-1762123974 None] Lock "cinder-quobyte-bf11f7bc-cbf7-4f59-a468-869a5579a17a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:45:39 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-0e67adfe-6f52-4941-9f5e-97d15db0f5e1 tempest-GroupSnapshotsTest-1762123974 None] Acquiring lock "cinder-quobyte-9a3df598-a61a-4dee-9659-fac01ef8eb66" by "_delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:45:39 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-0e67adfe-6f52-4941-9f5e-97d15db0f5e1 tempest-GroupSnapshotsTest-1762123974 None] Lock "cinder-quobyte-9a3df598-a61a-4dee-9659-fac01ef8eb66" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:45:39 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-0e67adfe-6f52-4941-9f5e-97d15db0f5e1 tempest-GroupSnapshotsTest-1762123974 None] Deleting offline snapshot 9a3df598-a61a-4dee-9659-fac01ef8eb66 of volume bf11f7bc-cbf7-4f59-a468-869a5579a17a {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 13:45:39 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-0e67adfe-6f52-4941-9f5e-97d15db0f5e1 tempest-GroupSnapshotsTest-1762123974 None] snapshot_file for this snap is: volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a.9a3df598-a61a-4dee-9659-fac01ef8eb66 {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 13:45:39 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[19401955-350d-4d83-8c1e-e0cff9bec46c]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:45:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0e67adfe-6f52-4941-9f5e-97d15db0f5e1 tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a.9a3df598-a61a-4dee-9659-fac01ef8eb66 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:39 devstack sudo[83743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a.9a3df598-a61a-4dee-9659-fac01ef8eb66 Apr 24 13:45:39 devstack sudo[83743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:40 devstack sudo[83737]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:40 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b97bc760-2304-49f9-bff0-d601de923fe8 tempest-GroupSnapshotsTest-1762123974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.752s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:40 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-b97bc760-2304-49f9-bff0-d601de923fe8 tempest-GroupSnapshotsTest-1762123974 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:45:40 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-b97bc760-2304-49f9-bff0-d601de923fe8 tempest-GroupSnapshotsTest-1762123974 None] Delete group completed successfully. Apr 24 13:45:40 devstack sudo[83735]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:40 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5cd3a74f-8a22-4272-a00c-03e8a84f095e tempest-GroupsTest-715821669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bcb49222-bf06-45d8-b6b5-92b40fa79f99 1073741824" returned: 0 in 1.156s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:40 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5cd3a74f-8a22-4272-a00c-03e8a84f095e tempest-GroupsTest-715821669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bcb49222-bf06-45d8-b6b5-92b40fa79f99 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:40 devstack sudo[83746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bcb49222-bf06-45d8-b6b5-92b40fa79f99 Apr 24 13:45:40 devstack sudo[83746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:40 devstack sudo[83743]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:40 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0e67adfe-6f52-4941-9f5e-97d15db0f5e1 tempest-GroupSnapshotsTest-1762123974 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a.9a3df598-a61a-4dee-9659-fac01ef8eb66" returned: 0 in 0.738s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:40 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-0e67adfe-6f52-4941-9f5e-97d15db0f5e1 tempest-GroupSnapshotsTest-1762123974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:45:40 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa42e7c-89b0-4dd6-b178-c92ff22fa5c7]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:45:40 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0e67adfe-6f52-4941-9f5e-97d15db0f5e1 tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:40 devstack sudo[83751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a Apr 24 13:45:40 devstack sudo[83751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:40 devstack sudo[83746]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:40 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5cd3a74f-8a22-4272-a00c-03e8a84f095e tempest-GroupsTest-715821669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bcb49222-bf06-45d8-b6b5-92b40fa79f99" returned: 0 in 0.521s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:40 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-5cd3a74f-8a22-4272-a00c-03e8a84f095e tempest-GroupsTest-715821669 None] <== create_volume: return (1717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:45:40 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5cd3a74f-8a22-4272-a00c-03e8a84f095e tempest-GroupsTest-715821669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.721s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:45:40 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5cd3a74f-8a22-4272-a00c-03e8a84f095e tempest-GroupsTest-715821669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50b870bb-8c67-4332-a5bc-913d3b393353) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcb49222-bf06-45d8-b6b5-92b40fa79f99', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:45:40 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5cd3a74f-8a22-4272-a00c-03e8a84f095e tempest-GroupsTest-715821669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eba266b-1364-4ff2-af6f-7aa91cdf1630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:45:40 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-5cd3a74f-8a22-4272-a00c-03e8a84f095e tempest-GroupsTest-715821669 None] Volume volume-bcb49222-bf06-45d8-b6b5-92b40fa79f99 (bcb49222-bf06-45d8-b6b5-92b40fa79f99): created successfully Apr 24 13:45:40 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5cd3a74f-8a22-4272-a00c-03e8a84f095e tempest-GroupsTest-715821669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eba266b-1364-4ff2-af6f-7aa91cdf1630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:45:40 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5cd3a74f-8a22-4272-a00c-03e8a84f095e tempest-GroupsTest-715821669 None] Flow 'volume_create_manager' (1a94aa70-2cd1-4c64-9b96-cb75ac2632ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:45:40 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-5cd3a74f-8a22-4272-a00c-03e8a84f095e tempest-GroupsTest-715821669 None] Created volume successfully. Apr 24 13:45:41 devstack sudo[83751]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0e67adfe-6f52-4941-9f5e-97d15db0f5e1 tempest-GroupSnapshotsTest-1762123974 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a" returned: 0 in 0.693s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0e67adfe-6f52-4941-9f5e-97d15db0f5e1 tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a.9a3df598-a61a-4dee-9659-fac01ef8eb66 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:41 devstack sudo[83757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a.9a3df598-a61a-4dee-9659-fac01ef8eb66 Apr 24 13:45:41 devstack sudo[83757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:41 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-02acd667-fe88-40fb-ab3a-5564c8cbd66e tempest-GroupsTest-715821669 None] Update group completed successfully. Apr 24 13:45:41 devstack sudo[83757]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0e67adfe-6f52-4941-9f5e-97d15db0f5e1 tempest-GroupSnapshotsTest-1762123974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a.9a3df598-a61a-4dee-9659-fac01ef8eb66" returned: 0 in 0.640s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0e67adfe-6f52-4941-9f5e-97d15db0f5e1 tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a.9a3df598-a61a-4dee-9659-fac01ef8eb66 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:42 devstack sudo[83762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a.9a3df598-a61a-4dee-9659-fac01ef8eb66 Apr 24 13:45:42 devstack sudo[83762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:42 devstack sudo[83762]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:42 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0e67adfe-6f52-4941-9f5e-97d15db0f5e1 tempest-GroupSnapshotsTest-1762123974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a.9a3df598-a61a-4dee-9659-fac01ef8eb66" returned: 0 in 0.640s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:42 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-0e67adfe-6f52-4941-9f5e-97d15db0f5e1 tempest-GroupSnapshotsTest-1762123974 None] Lock "cinder-quobyte-9a3df598-a61a-4dee-9659-fac01ef8eb66" released by "_delete_snapshot" :: held 2.857s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:45:42 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-0e67adfe-6f52-4941-9f5e-97d15db0f5e1 tempest-GroupSnapshotsTest-1762123974 None] Lock "cinder-quobyte-bf11f7bc-cbf7-4f59-a468-869a5579a17a" released by "delete_snapshot" :: held 2.896s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:45:42 devstack cinder-volume[82046]: WARNING cinder.quota [None req-0e67adfe-6f52-4941-9f5e-97d15db0f5e1 tempest-GroupSnapshotsTest-1762123974 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-973891764 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-973891764, it is now deprecated. Please use the default quota class for default quota. Apr 24 13:45:42 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-0e67adfe-6f52-4941-9f5e-97d15db0f5e1 tempest-GroupSnapshotsTest-1762123974 None] Created reservations ['4f31ffed-7e9e-43d1-af35-3223ed08eb16', 'b43ec6c3-47ba-43e0-946f-e0e25202796f', '6e1fa0c6-58b2-4ec1-b893-4a0c0bfa2994', '3e283d7b-da61-4f80-9ae8-e3056640a00a'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:45:42 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-0e67adfe-6f52-4941-9f5e-97d15db0f5e1 tempest-GroupSnapshotsTest-1762123974 None] group_snapshot 2f8d7dff-ed9e-487c-bd21-971b3aef0a00: deleted successfully Apr 24 13:45:42 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-229e8f24-ec8b-498c-8bb5-b82f0b5247cc tempest-GroupsTest-715821669 None] Update group completed successfully. Apr 24 13:45:43 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d781008b-06b9-40a4-b9d6-46fdf0a15973 tempest-GroupSnapshotsTest-1762123974 None] Acquiring lock "cinder-quobyte-bf11f7bc-cbf7-4f59-a468-869a5579a17a" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:45:43 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d781008b-06b9-40a4-b9d6-46fdf0a15973 tempest-GroupSnapshotsTest-1762123974 None] Lock "cinder-quobyte-bf11f7bc-cbf7-4f59-a468-869a5579a17a" acquired by "delete_volume" :: waited 0.018s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:45:43 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f7c9f9-6795-4fa0-b10f-4f7e33cfd05c]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:45:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d781008b-06b9-40a4-b9d6-46fdf0a15973 tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:43 devstack sudo[83766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a Apr 24 13:45:43 devstack sudo[83766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:44 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-5a0fdc86-c9b2-46e9-b18a-e91a1e8314ac tempest-GroupsTest-715821669 None] Acquiring lock "cinder-quobyte-4ac56d54-e05f-4d11-874d-df924a8af7ee" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:45:44 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-5a0fdc86-c9b2-46e9-b18a-e91a1e8314ac tempest-GroupsTest-715821669 None] Lock "cinder-quobyte-4ac56d54-e05f-4d11-874d-df924a8af7ee" acquired by "delete_volume" :: waited 0.028s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:45:44 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbf1b29-a478-4e32-9998-900b0768ea4d]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:45:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5a0fdc86-c9b2-46e9-b18a-e91a1e8314ac tempest-GroupsTest-715821669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4ac56d54-e05f-4d11-874d-df924a8af7ee {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:44 devstack sudo[83766]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d781008b-06b9-40a4-b9d6-46fdf0a15973 tempest-GroupSnapshotsTest-1762123974 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a" returned: 0 in 1.135s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d781008b-06b9-40a4-b9d6-46fdf0a15973 tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:44 devstack sudo[83777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a Apr 24 13:45:44 devstack sudo[83777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:44 devstack sudo[83776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4ac56d54-e05f-4d11-874d-df924a8af7ee Apr 24 13:45:44 devstack sudo[83776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:45 devstack sudo[83776]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5a0fdc86-c9b2-46e9-b18a-e91a1e8314ac tempest-GroupsTest-715821669 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4ac56d54-e05f-4d11-874d-df924a8af7ee" returned: 0 in 0.820s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5a0fdc86-c9b2-46e9-b18a-e91a1e8314ac tempest-GroupsTest-715821669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4ac56d54-e05f-4d11-874d-df924a8af7ee {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:45 devstack sudo[83796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4ac56d54-e05f-4d11-874d-df924a8af7ee Apr 24 13:45:45 devstack sudo[83796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:45 devstack sudo[83777]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d781008b-06b9-40a4-b9d6-46fdf0a15973 tempest-GroupSnapshotsTest-1762123974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bf11f7bc-cbf7-4f59-a468-869a5579a17a" returned: 0 in 0.756s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:45 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d781008b-06b9-40a4-b9d6-46fdf0a15973 tempest-GroupSnapshotsTest-1762123974 None] Lock "cinder-quobyte-bf11f7bc-cbf7-4f59-a468-869a5579a17a" released by "delete_volume" :: held 1.991s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:45:45 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-d781008b-06b9-40a4-b9d6-46fdf0a15973 tempest-GroupSnapshotsTest-1762123974 None] Created reservations ['5b908694-f0bd-461d-88cc-863b6fba0866'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:45:45 devstack cinder-volume[82046]: WARNING cinder.db.sqlalchemy.api [None req-d781008b-06b9-40a4-b9d6-46fdf0a15973 tempest-GroupSnapshotsTest-1762123974 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-973891764'] Apr 24 13:45:45 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-d781008b-06b9-40a4-b9d6-46fdf0a15973 tempest-GroupSnapshotsTest-1762123974 None] Created reservations ['bbbe3b50-5235-4924-a0cc-b52a02297d3e', '57fcfc94-4888-412e-8efb-6d85ebbca3ac', '3d8e0007-9b96-42cf-8e26-553dfc1c0f8f', 'ece5548c-027c-4268-ac7e-3f013e36dc5e'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:45:46 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d781008b-06b9-40a4-b9d6-46fdf0a15973 tempest-GroupSnapshotsTest-1762123974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:45:46 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d781008b-06b9-40a4-b9d6-46fdf0a15973 tempest-GroupSnapshotsTest-1762123974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:45:46 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-d781008b-06b9-40a4-b9d6-46fdf0a15973 tempest-GroupSnapshotsTest-1762123974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:45:46 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-d781008b-06b9-40a4-b9d6-46fdf0a15973 tempest-GroupSnapshotsTest-1762123974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:45:46 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d781008b-06b9-40a4-b9d6-46fdf0a15973 tempest-GroupSnapshotsTest-1762123974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:45:46 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d781008b-06b9-40a4-b9d6-46fdf0a15973 tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:46 devstack sudo[83798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:45:46 devstack sudo[83798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:46 devstack sudo[83796]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:46 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5a0fdc86-c9b2-46e9-b18a-e91a1e8314ac tempest-GroupsTest-715821669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4ac56d54-e05f-4d11-874d-df924a8af7ee" returned: 0 in 0.803s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:46 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-5a0fdc86-c9b2-46e9-b18a-e91a1e8314ac tempest-GroupsTest-715821669 None] Lock "cinder-quobyte-4ac56d54-e05f-4d11-874d-df924a8af7ee" released by "delete_volume" :: held 1.685s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:45:46 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-5a0fdc86-c9b2-46e9-b18a-e91a1e8314ac tempest-GroupsTest-715821669 None] Acquiring lock "cinder-quobyte-bcb49222-bf06-45d8-b6b5-92b40fa79f99" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:45:46 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-5a0fdc86-c9b2-46e9-b18a-e91a1e8314ac tempest-GroupsTest-715821669 None] Lock "cinder-quobyte-bcb49222-bf06-45d8-b6b5-92b40fa79f99" acquired by "delete_volume" :: waited 0.027s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:45:46 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[53821976-8b45-47b5-922c-84d07c9f2cd5]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:45:46 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5a0fdc86-c9b2-46e9-b18a-e91a1e8314ac tempest-GroupsTest-715821669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bcb49222-bf06-45d8-b6b5-92b40fa79f99 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:46 devstack sudo[83803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bcb49222-bf06-45d8-b6b5-92b40fa79f99 Apr 24 13:45:46 devstack sudo[83803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:46 devstack sudo[83798]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:46 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d781008b-06b9-40a4-b9d6-46fdf0a15973 tempest-GroupSnapshotsTest-1762123974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.581s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:46 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-d781008b-06b9-40a4-b9d6-46fdf0a15973 tempest-GroupSnapshotsTest-1762123974 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:45:46 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-d781008b-06b9-40a4-b9d6-46fdf0a15973 tempest-GroupSnapshotsTest-1762123974 None] Delete group completed successfully. Apr 24 13:45:47 devstack sudo[83803]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5a0fdc86-c9b2-46e9-b18a-e91a1e8314ac tempest-GroupsTest-715821669 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bcb49222-bf06-45d8-b6b5-92b40fa79f99" returned: 0 in 0.626s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5a0fdc86-c9b2-46e9-b18a-e91a1e8314ac tempest-GroupsTest-715821669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bcb49222-bf06-45d8-b6b5-92b40fa79f99 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:47 devstack sudo[83809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bcb49222-bf06-45d8-b6b5-92b40fa79f99 Apr 24 13:45:47 devstack sudo[83809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:47 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-db37c24e-be98-43b8-8a59-8b63c29f6aee tempest-GroupSnapshotsTest-1762123974 None] Group tempest-GroupSnapshotsTest-Group-1331051705: creating Apr 24 13:45:47 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-db37c24e-be98-43b8-8a59-8b63c29f6aee tempest-GroupSnapshotsTest-1762123974 None] Group tempest-GroupSnapshotsTest-Group-1331051705: created successfully Apr 24 13:45:47 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-db37c24e-be98-43b8-8a59-8b63c29f6aee tempest-GroupSnapshotsTest-1762123974 None] Create group completed successfully. Apr 24 13:45:47 devstack sudo[83809]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5a0fdc86-c9b2-46e9-b18a-e91a1e8314ac tempest-GroupsTest-715821669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bcb49222-bf06-45d8-b6b5-92b40fa79f99" returned: 0 in 0.718s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:47 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-5a0fdc86-c9b2-46e9-b18a-e91a1e8314ac tempest-GroupsTest-715821669 None] Lock "cinder-quobyte-bcb49222-bf06-45d8-b6b5-92b40fa79f99" released by "delete_volume" :: held 1.414s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:45:47 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-5a0fdc86-c9b2-46e9-b18a-e91a1e8314ac tempest-GroupsTest-715821669 None] Created reservations ['1a835914-f487-49f6-a18b-4f89dc8fb289'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:45:47 devstack cinder-volume[82046]: WARNING cinder.quota [None req-5a0fdc86-c9b2-46e9-b18a-e91a1e8314ac tempest-GroupsTest-715821669 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1059613344 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1059613344, it is now deprecated. Please use the default quota class for default quota. Apr 24 13:45:47 devstack cinder-volume[82046]: WARNING cinder.quota [None req-5a0fdc86-c9b2-46e9-b18a-e91a1e8314ac tempest-GroupsTest-715821669 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1059613344 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1059613344, it is now deprecated. Please use the default quota class for default quota. Apr 24 13:45:47 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-5a0fdc86-c9b2-46e9-b18a-e91a1e8314ac tempest-GroupsTest-715821669 None] Created reservations ['186f1c28-6df8-432b-837e-54b1148efaa7', '4a5d44fd-ef1b-4773-8ace-88d748423d32', 'f2edc68f-3cc8-4b99-a573-6797c1d6d7f3', '6bbd3f76-2d8e-49ef-8707-9dd267fe0189'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:45:48 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-5a0fdc86-c9b2-46e9-b18a-e91a1e8314ac tempest-GroupsTest-715821669 None] Created reservations ['0269ecc4-459a-4eb5-aab0-7e355816f85e', '1b09e866-9a64-49ac-ac5c-d5fec9ae3813', '20cb253c-7a63-459a-bd46-7e0248440e98', 'a46e49ed-5f27-4406-89fd-659da90b7103'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:45:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5a0fdc86-c9b2-46e9-b18a-e91a1e8314ac tempest-GroupsTest-715821669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:45:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5a0fdc86-c9b2-46e9-b18a-e91a1e8314ac tempest-GroupsTest-715821669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:45:48 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-5a0fdc86-c9b2-46e9-b18a-e91a1e8314ac tempest-GroupsTest-715821669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:45:48 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-5a0fdc86-c9b2-46e9-b18a-e91a1e8314ac tempest-GroupsTest-715821669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:45:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5a0fdc86-c9b2-46e9-b18a-e91a1e8314ac tempest-GroupsTest-715821669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:45:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5a0fdc86-c9b2-46e9-b18a-e91a1e8314ac tempest-GroupsTest-715821669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:48 devstack sudo[83812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:45:48 devstack sudo[83812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:49 devstack sudo[83812]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5a0fdc86-c9b2-46e9-b18a-e91a1e8314ac tempest-GroupsTest-715821669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.780s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:49 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-5a0fdc86-c9b2-46e9-b18a-e91a1e8314ac tempest-GroupsTest-715821669 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:45:49 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-5a0fdc86-c9b2-46e9-b18a-e91a1e8314ac tempest-GroupsTest-715821669 None] Delete group completed successfully. Apr 24 13:45:49 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-257c9def-d5f7-4a90-a9ac-71b637fe6b4b tempest-GroupSnapshotsTest-1762123974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:45:49 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-257c9def-d5f7-4a90-a9ac-71b637fe6b4b tempest-GroupSnapshotsTest-1762123974 None] Flow 'volume_create_manager' (0c85a67d-c856-4582-954d-1eca9b9f5414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:45:49 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-257c9def-d5f7-4a90-a9ac-71b637fe6b4b tempest-GroupSnapshotsTest-1762123974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04a7061c-3ea2-46a2-8c82-5faec6fa9609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:45:49 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-257c9def-d5f7-4a90-a9ac-71b637fe6b4b tempest-GroupSnapshotsTest-1762123974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04a7061c-3ea2-46a2-8c82-5faec6fa9609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1936273917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fa010c27-d459-4242-addc-05d9c982b1f7,host='devstack@QuobyteHD#QuobyteHD',id=30d5dad2-1201-4854-a5f1-1f0d1f8ac811,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4246a8fe8dcd4b2e9ca8333916bc2f43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:45:49Z,use_quota=True,user_id='d088ccb065cb430db99c689f055c7437',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6006d83-62b9-4425-b904-95bf84c5b477),volume_type_id=f6006d83-62b9-4425-b904-95bf84c5b477)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:45:49 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-257c9def-d5f7-4a90-a9ac-71b637fe6b4b tempest-GroupSnapshotsTest-1762123974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16851c14-25ff-403e-9693-5b4c5ecbc354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:45:49 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-257c9def-d5f7-4a90-a9ac-71b637fe6b4b tempest-GroupSnapshotsTest-1762123974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16851c14-25ff-403e-9693-5b4c5ecbc354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:45:49 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-257c9def-d5f7-4a90-a9ac-71b637fe6b4b tempest-GroupSnapshotsTest-1762123974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53fdab48-f02d-4fbf-9fb9-22363e2f4e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:45:49 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-257c9def-d5f7-4a90-a9ac-71b637fe6b4b tempest-GroupSnapshotsTest-1762123974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53fdab48-f02d-4fbf-9fb9-22363e2f4e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30d5dad2-1201-4854-a5f1-1f0d1f8ac811', 'volume_name': 'volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:45:49 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-257c9def-d5f7-4a90-a9ac-71b637fe6b4b tempest-GroupSnapshotsTest-1762123974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b6060b0-934f-46a7-b459-6873578467bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:45:49 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-257c9def-d5f7-4a90-a9ac-71b637fe6b4b tempest-GroupSnapshotsTest-1762123974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b6060b0-934f-46a7-b459-6873578467bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:45:49 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-257c9def-d5f7-4a90-a9ac-71b637fe6b4b tempest-GroupSnapshotsTest-1762123974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1f73248-3998-4eba-b94e-f30ad730d1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:45:49 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-257c9def-d5f7-4a90-a9ac-71b637fe6b4b tempest-GroupSnapshotsTest-1762123974 None] Volume 30d5dad2-1201-4854-a5f1-1f0d1f8ac811: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811', 'volume_size': 1} Apr 24 13:45:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-257c9def-d5f7-4a90-a9ac-71b637fe6b4b tempest-GroupSnapshotsTest-1762123974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:45:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-257c9def-d5f7-4a90-a9ac-71b637fe6b4b tempest-GroupSnapshotsTest-1762123974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:45:49 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-257c9def-d5f7-4a90-a9ac-71b637fe6b4b tempest-GroupSnapshotsTest-1762123974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fa010c27-d459-4242-addc-05d9c982b1f7,created_at=2026-04-24T11:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1936273917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fa010c27-d459-4242-addc-05d9c982b1f7,host='devstack@QuobyteHD#QuobyteHD',id=30d5dad2-1201-4854-a5f1-1f0d1f8ac811,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4246a8fe8dcd4b2e9ca8333916bc2f43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:45:49Z,use_quota=True,user_id='d088ccb065cb430db99c689f055c7437',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6006d83-62b9-4425-b904-95bf84c5b477),volume_type_id=f6006d83-62b9-4425-b904-95bf84c5b477)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:45:49 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-257c9def-d5f7-4a90-a9ac-71b637fe6b4b tempest-GroupSnapshotsTest-1762123974 None] Creating volume 30d5dad2-1201-4854-a5f1-1f0d1f8ac811 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:45:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-257c9def-d5f7-4a90-a9ac-71b637fe6b4b tempest-GroupSnapshotsTest-1762123974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:45:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-257c9def-d5f7-4a90-a9ac-71b637fe6b4b tempest-GroupSnapshotsTest-1762123974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:45:49 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-257c9def-d5f7-4a90-a9ac-71b637fe6b4b tempest-GroupSnapshotsTest-1762123974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:45:49 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-257c9def-d5f7-4a90-a9ac-71b637fe6b4b tempest-GroupSnapshotsTest-1762123974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:45:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-257c9def-d5f7-4a90-a9ac-71b637fe6b4b tempest-GroupSnapshotsTest-1762123974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:45:49 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-257c9def-d5f7-4a90-a9ac-71b637fe6b4b tempest-GroupSnapshotsTest-1762123974 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:45:49 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-257c9def-d5f7-4a90-a9ac-71b637fe6b4b tempest-GroupSnapshotsTest-1762123974 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:45:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-257c9def-d5f7-4a90-a9ac-71b637fe6b4b tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:49 devstack sudo[83821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811 1073741824 Apr 24 13:45:49 devstack sudo[83821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:50 devstack sudo[83821]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-257c9def-d5f7-4a90-a9ac-71b637fe6b4b tempest-GroupSnapshotsTest-1762123974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811 1073741824" returned: 0 in 0.950s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-257c9def-d5f7-4a90-a9ac-71b637fe6b4b tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:50 devstack sudo[83829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811 Apr 24 13:45:50 devstack sudo[83829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:51 devstack sudo[83829]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-257c9def-d5f7-4a90-a9ac-71b637fe6b4b tempest-GroupSnapshotsTest-1762123974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811" returned: 0 in 0.847s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:51 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-257c9def-d5f7-4a90-a9ac-71b637fe6b4b tempest-GroupSnapshotsTest-1762123974 None] <== create_volume: return (1855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:45:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-257c9def-d5f7-4a90-a9ac-71b637fe6b4b tempest-GroupSnapshotsTest-1762123974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.858s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:45:51 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-257c9def-d5f7-4a90-a9ac-71b637fe6b4b tempest-GroupSnapshotsTest-1762123974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1f73248-3998-4eba-b94e-f30ad730d1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:45:51 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-257c9def-d5f7-4a90-a9ac-71b637fe6b4b tempest-GroupSnapshotsTest-1762123974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dacdda55-3058-4f66-ac6a-a0cc446a10da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:45:51 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-257c9def-d5f7-4a90-a9ac-71b637fe6b4b tempest-GroupSnapshotsTest-1762123974 None] Volume volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811 (30d5dad2-1201-4854-a5f1-1f0d1f8ac811): created successfully Apr 24 13:45:51 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-257c9def-d5f7-4a90-a9ac-71b637fe6b4b tempest-GroupSnapshotsTest-1762123974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dacdda55-3058-4f66-ac6a-a0cc446a10da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:45:51 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-257c9def-d5f7-4a90-a9ac-71b637fe6b4b tempest-GroupSnapshotsTest-1762123974 None] Flow 'volume_create_manager' (0c85a67d-c856-4582-954d-1eca9b9f5414) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:45:51 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-257c9def-d5f7-4a90-a9ac-71b637fe6b4b tempest-GroupSnapshotsTest-1762123974 None] Created volume successfully. Apr 24 13:45:53 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1194563-c581-417f-b76d-545006c51cfd tempest-GroupSnapshotsTest-1762123974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:45:53 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b1194563-c581-417f-b76d-545006c51cfd tempest-GroupSnapshotsTest-1762123974 None] Flow 'volume_create_manager' (72f40eaf-985f-415f-9339-3a8d92b8a43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:45:53 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b1194563-c581-417f-b76d-545006c51cfd tempest-GroupSnapshotsTest-1762123974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9964c702-c8a5-4db0-9867-a369d4f85874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:45:53 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b1194563-c581-417f-b76d-545006c51cfd tempest-GroupSnapshotsTest-1762123974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9964c702-c8a5-4db0-9867-a369d4f85874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:45:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1137415961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fa010c27-d459-4242-addc-05d9c982b1f7,host='devstack@QuobyteHD#QuobyteHD',id=367a3087-350d-4419-9f01-4e1152cd4517,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4246a8fe8dcd4b2e9ca8333916bc2f43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:45:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:45:54Z,use_quota=True,user_id='d088ccb065cb430db99c689f055c7437',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6006d83-62b9-4425-b904-95bf84c5b477),volume_type_id=f6006d83-62b9-4425-b904-95bf84c5b477)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:45:53 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b1194563-c581-417f-b76d-545006c51cfd tempest-GroupSnapshotsTest-1762123974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ebf4d48-e091-4f13-81c0-5437210f348a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:45:53 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b1194563-c581-417f-b76d-545006c51cfd tempest-GroupSnapshotsTest-1762123974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ebf4d48-e091-4f13-81c0-5437210f348a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:45:53 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b1194563-c581-417f-b76d-545006c51cfd tempest-GroupSnapshotsTest-1762123974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b64f169-bca6-4666-925b-88a685940e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:45:53 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b1194563-c581-417f-b76d-545006c51cfd tempest-GroupSnapshotsTest-1762123974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b64f169-bca6-4666-925b-88a685940e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '367a3087-350d-4419-9f01-4e1152cd4517', 'volume_name': 'volume-367a3087-350d-4419-9f01-4e1152cd4517', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:45:53 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b1194563-c581-417f-b76d-545006c51cfd tempest-GroupSnapshotsTest-1762123974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5765a17-ae24-4577-b296-05cbb9393245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:45:53 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b1194563-c581-417f-b76d-545006c51cfd tempest-GroupSnapshotsTest-1762123974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5765a17-ae24-4577-b296-05cbb9393245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:45:53 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b1194563-c581-417f-b76d-545006c51cfd tempest-GroupSnapshotsTest-1762123974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (322dafba-bd9e-4e6c-9848-447c56ac8e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:45:53 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-b1194563-c581-417f-b76d-545006c51cfd tempest-GroupSnapshotsTest-1762123974 None] Volume 367a3087-350d-4419-9f01-4e1152cd4517: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-367a3087-350d-4419-9f01-4e1152cd4517', 'volume_size': 1} Apr 24 13:45:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b1194563-c581-417f-b76d-545006c51cfd tempest-GroupSnapshotsTest-1762123974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:45:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b1194563-c581-417f-b76d-545006c51cfd tempest-GroupSnapshotsTest-1762123974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:45:53 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b1194563-c581-417f-b76d-545006c51cfd tempest-GroupSnapshotsTest-1762123974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fa010c27-d459-4242-addc-05d9c982b1f7,created_at=2026-04-24T11:45:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1137415961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fa010c27-d459-4242-addc-05d9c982b1f7,host='devstack@QuobyteHD#QuobyteHD',id=367a3087-350d-4419-9f01-4e1152cd4517,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4246a8fe8dcd4b2e9ca8333916bc2f43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:45:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:45:54Z,use_quota=True,user_id='d088ccb065cb430db99c689f055c7437',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6006d83-62b9-4425-b904-95bf84c5b477),volume_type_id=f6006d83-62b9-4425-b904-95bf84c5b477)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:45:53 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-b1194563-c581-417f-b76d-545006c51cfd tempest-GroupSnapshotsTest-1762123974 None] Creating volume 367a3087-350d-4419-9f01-4e1152cd4517 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:45:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b1194563-c581-417f-b76d-545006c51cfd tempest-GroupSnapshotsTest-1762123974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:45:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b1194563-c581-417f-b76d-545006c51cfd tempest-GroupSnapshotsTest-1762123974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:45:53 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b1194563-c581-417f-b76d-545006c51cfd tempest-GroupSnapshotsTest-1762123974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:45:53 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b1194563-c581-417f-b76d-545006c51cfd tempest-GroupSnapshotsTest-1762123974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:45:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b1194563-c581-417f-b76d-545006c51cfd tempest-GroupSnapshotsTest-1762123974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:45:53 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b1194563-c581-417f-b76d-545006c51cfd tempest-GroupSnapshotsTest-1762123974 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:45:53 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-b1194563-c581-417f-b76d-545006c51cfd tempest-GroupSnapshotsTest-1762123974 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:45:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b1194563-c581-417f-b76d-545006c51cfd tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-367a3087-350d-4419-9f01-4e1152cd4517 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:53 devstack sudo[83877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-367a3087-350d-4419-9f01-4e1152cd4517 1073741824 Apr 24 13:45:53 devstack sudo[83877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:55 devstack sudo[83877]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:55 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b1194563-c581-417f-b76d-545006c51cfd tempest-GroupSnapshotsTest-1762123974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-367a3087-350d-4419-9f01-4e1152cd4517 1073741824" returned: 0 in 1.781s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:55 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b1194563-c581-417f-b76d-545006c51cfd tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-367a3087-350d-4419-9f01-4e1152cd4517 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:45:55 devstack sudo[83886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-367a3087-350d-4419-9f01-4e1152cd4517 Apr 24 13:45:55 devstack sudo[83886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:45:56 devstack sudo[83886]: pam_unix(sudo:session): session closed for user root Apr 24 13:45:56 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b1194563-c581-417f-b76d-545006c51cfd tempest-GroupSnapshotsTest-1762123974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-367a3087-350d-4419-9f01-4e1152cd4517" returned: 0 in 0.773s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:45:56 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b1194563-c581-417f-b76d-545006c51cfd tempest-GroupSnapshotsTest-1762123974 None] <== create_volume: return (2640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:45:56 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b1194563-c581-417f-b76d-545006c51cfd tempest-GroupSnapshotsTest-1762123974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.643s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:45:56 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b1194563-c581-417f-b76d-545006c51cfd tempest-GroupSnapshotsTest-1762123974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (322dafba-bd9e-4e6c-9848-447c56ac8e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-367a3087-350d-4419-9f01-4e1152cd4517', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:45:56 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b1194563-c581-417f-b76d-545006c51cfd tempest-GroupSnapshotsTest-1762123974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1437103-13d4-4916-aaeb-93304a9f2625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:45:56 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-b1194563-c581-417f-b76d-545006c51cfd tempest-GroupSnapshotsTest-1762123974 None] Volume volume-367a3087-350d-4419-9f01-4e1152cd4517 (367a3087-350d-4419-9f01-4e1152cd4517): created successfully Apr 24 13:45:56 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b1194563-c581-417f-b76d-545006c51cfd tempest-GroupSnapshotsTest-1762123974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1437103-13d4-4916-aaeb-93304a9f2625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:45:56 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b1194563-c581-417f-b76d-545006c51cfd tempest-GroupSnapshotsTest-1762123974 None] Flow 'volume_create_manager' (72f40eaf-985f-415f-9339-3a8d92b8a43f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:45:56 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-b1194563-c581-417f-b76d-545006c51cfd tempest-GroupSnapshotsTest-1762123974 None] Created volume successfully. Apr 24 13:45:57 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-e0d9a7f4-3349-4beb-b550-22c8e5bdcda3 tempest-GroupSnapshotsTest-1762123974 None] Update group completed successfully. Apr 24 13:45:58 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-1668d498-52cf-478b-9469-e7a7c6063ae6 tempest-GroupSnapshotsTest-1762123974 None] Update group completed successfully. Apr 24 13:46:00 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-f5c15fbd-31d2-49ac-ad77-9a8b4799ccaa tempest-GroupSnapshotsTest-1762123974 None] Update group completed successfully. Apr 24 13:46:00 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-be5d6680-c0dc-4a56-86e7-3ed22bdd8035 tempest-GroupsV314Test-191084596 None] Group tempest-GroupsV314Test-Group-401666437: creating Apr 24 13:46:00 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-be5d6680-c0dc-4a56-86e7-3ed22bdd8035 tempest-GroupsV314Test-191084596 None] Group tempest-GroupsV314Test-Group-401666437: created successfully Apr 24 13:46:00 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-be5d6680-c0dc-4a56-86e7-3ed22bdd8035 tempest-GroupsV314Test-191084596 None] Create group completed successfully. Apr 24 13:46:01 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-f2f2116b-2a30-475b-ad75-4091e3ff7d54 tempest-GroupSnapshotsTest-1762123974 None] Update group completed successfully. Apr 24 13:46:02 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-31498293-3985-4ed0-8763-75b69749566f tempest-GroupSnapshotsTest-1762123974 None] GroupSnapshot 8a927a6c-baf2-4cac-945c-b89517604082: creating. Apr 24 13:46:02 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-31498293-3985-4ed0-8763-75b69749566f tempest-GroupSnapshotsTest-1762123974 None] Group snapshot 8a927a6c-baf2-4cac-945c-b89517604082: creating. {{(pid=82046) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 24 13:46:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-31498293-3985-4ed0-8763-75b69749566f tempest-GroupSnapshotsTest-1762123974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:46:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-31498293-3985-4ed0-8763-75b69749566f tempest-GroupSnapshotsTest-1762123974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:46:02 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-31498293-3985-4ed0-8763-75b69749566f tempest-GroupSnapshotsTest-1762123974 None] Creating offline snapshot a364e218-c1bb-4029-abb2-275167d571d7 of volume 367a3087-350d-4419-9f01-4e1152cd4517 {{(pid=82046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 13:46:02 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a80c45-a245-4921-812f-c4fd3fac1daf]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:46:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-31498293-3985-4ed0-8763-75b69749566f tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-367a3087-350d-4419-9f01-4e1152cd4517 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:02 devstack sudo[83898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-367a3087-350d-4419-9f01-4e1152cd4517 Apr 24 13:46:02 devstack sudo[83898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:02 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1b658ff-d37d-4549-a39f-13bbfb52be34 tempest-GroupsV314Test-191084596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:46:02 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b1b658ff-d37d-4549-a39f-13bbfb52be34 tempest-GroupsV314Test-191084596 None] Flow 'volume_create_manager' (270ba894-2819-4688-903b-9a67b505725e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:46:02 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b1b658ff-d37d-4549-a39f-13bbfb52be34 tempest-GroupsV314Test-191084596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c284e12-0b32-4a07-9998-24fc2e5c9720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:46:02 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b1b658ff-d37d-4549-a39f-13bbfb52be34 tempest-GroupsV314Test-191084596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c284e12-0b32-4a07-9998-24fc2e5c9720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1749251274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=35acf07c-d3a7-4aa9-9ef7-3c35b212549b,host='devstack@QuobyteHD#QuobyteHD',id=860e4488-5acc-45e1-9a1d-2f553ce53dad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed39270e175f4d418812899707bfb417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:46:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:46:03Z,use_quota=True,user_id='a14f02e5f8f1417785246bd7e5d1ba4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9dc0db5-18c7-4deb-941b-6b185d3e70e1),volume_type_id=d9dc0db5-18c7-4deb-941b-6b185d3e70e1)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:46:02 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b1b658ff-d37d-4549-a39f-13bbfb52be34 tempest-GroupsV314Test-191084596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b88a0476-3411-4b60-8908-3f375872b771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:46:02 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b1b658ff-d37d-4549-a39f-13bbfb52be34 tempest-GroupsV314Test-191084596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b88a0476-3411-4b60-8908-3f375872b771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:46:02 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b1b658ff-d37d-4549-a39f-13bbfb52be34 tempest-GroupsV314Test-191084596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b8f8491-9d44-4e09-bb45-06a1760d973c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:46:02 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b1b658ff-d37d-4549-a39f-13bbfb52be34 tempest-GroupsV314Test-191084596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b8f8491-9d44-4e09-bb45-06a1760d973c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '860e4488-5acc-45e1-9a1d-2f553ce53dad', 'volume_name': 'volume-860e4488-5acc-45e1-9a1d-2f553ce53dad', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:46:02 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b1b658ff-d37d-4549-a39f-13bbfb52be34 tempest-GroupsV314Test-191084596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cba9ab2-785b-4b86-82ce-a45152021421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:46:02 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b1b658ff-d37d-4549-a39f-13bbfb52be34 tempest-GroupsV314Test-191084596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cba9ab2-785b-4b86-82ce-a45152021421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:46:02 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b1b658ff-d37d-4549-a39f-13bbfb52be34 tempest-GroupsV314Test-191084596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c136d1e-4f90-4b1c-852c-2b9a0f79112c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:46:02 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-b1b658ff-d37d-4549-a39f-13bbfb52be34 tempest-GroupsV314Test-191084596 None] Volume 860e4488-5acc-45e1-9a1d-2f553ce53dad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-860e4488-5acc-45e1-9a1d-2f553ce53dad', 'volume_size': 1} Apr 24 13:46:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b1b658ff-d37d-4549-a39f-13bbfb52be34 tempest-GroupsV314Test-191084596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:46:03 devstack sudo[83898]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-31498293-3985-4ed0-8763-75b69749566f tempest-GroupSnapshotsTest-1762123974 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-367a3087-350d-4419-9f01-4e1152cd4517" returned: 0 in 0.990s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-31498293-3985-4ed0-8763-75b69749566f tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-367a3087-350d-4419-9f01-4e1152cd4517,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-367a3087-350d-4419-9f01-4e1152cd4517.a364e218-c1bb-4029-abb2-275167d571d7 1G {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:03 devstack sudo[83922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-367a3087-350d-4419-9f01-4e1152cd4517,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-367a3087-350d-4419-9f01-4e1152cd4517.a364e218-c1bb-4029-abb2-275167d571d7 1G Apr 24 13:46:03 devstack sudo[83922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:04 devstack sudo[83922]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:04 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-31498293-3985-4ed0-8763-75b69749566f tempest-GroupSnapshotsTest-1762123974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-367a3087-350d-4419-9f01-4e1152cd4517,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-367a3087-350d-4419-9f01-4e1152cd4517.a364e218-c1bb-4029-abb2-275167d571d7 1G" returned: 0 in 1.139s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:04 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-31498293-3985-4ed0-8763-75b69749566f tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-367a3087-350d-4419-9f01-4e1152cd4517 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-367a3087-350d-4419-9f01-4e1152cd4517.a364e218-c1bb-4029-abb2-275167d571d7 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:04 devstack sudo[83941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-367a3087-350d-4419-9f01-4e1152cd4517 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-367a3087-350d-4419-9f01-4e1152cd4517.a364e218-c1bb-4029-abb2-275167d571d7 Apr 24 13:46:04 devstack sudo[83941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:05 devstack sudo[83941]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:05 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-31498293-3985-4ed0-8763-75b69749566f tempest-GroupSnapshotsTest-1762123974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-367a3087-350d-4419-9f01-4e1152cd4517 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-367a3087-350d-4419-9f01-4e1152cd4517.a364e218-c1bb-4029-abb2-275167d571d7" returned: 0 in 0.714s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:05 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-31498293-3985-4ed0-8763-75b69749566f tempest-GroupSnapshotsTest-1762123974 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-367a3087-350d-4419-9f01-4e1152cd4517.a364e218-c1bb-4029-abb2-275167d571d7 is being set with open permissions: ugo+rw: NotImplementedError Apr 24 13:46:05 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-31498293-3985-4ed0-8763-75b69749566f tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-367a3087-350d-4419-9f01-4e1152cd4517.a364e218-c1bb-4029-abb2-275167d571d7 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:05 devstack sudo[83946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-367a3087-350d-4419-9f01-4e1152cd4517.a364e218-c1bb-4029-abb2-275167d571d7 Apr 24 13:46:05 devstack sudo[83946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:05 devstack sudo[83946]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:05 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-31498293-3985-4ed0-8763-75b69749566f tempest-GroupSnapshotsTest-1762123974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-367a3087-350d-4419-9f01-4e1152cd4517.a364e218-c1bb-4029-abb2-275167d571d7" returned: 0 in 0.713s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:05 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-31498293-3985-4ed0-8763-75b69749566f tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-367a3087-350d-4419-9f01-4e1152cd4517.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:05 devstack sudo[83950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-367a3087-350d-4419-9f01-4e1152cd4517.info Apr 24 13:46:05 devstack sudo[83950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:06 devstack sudo[83950]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-31498293-3985-4ed0-8763-75b69749566f tempest-GroupSnapshotsTest-1762123974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-367a3087-350d-4419-9f01-4e1152cd4517.info" returned: 0 in 0.698s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:06 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-31498293-3985-4ed0-8763-75b69749566f tempest-GroupSnapshotsTest-1762123974 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-367a3087-350d-4419-9f01-4e1152cd4517.info is being set with open permissions: ugo+rw: NotImplementedError Apr 24 13:46:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-31498293-3985-4ed0-8763-75b69749566f tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-367a3087-350d-4419-9f01-4e1152cd4517.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:06 devstack sudo[83983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-367a3087-350d-4419-9f01-4e1152cd4517.info Apr 24 13:46:06 devstack sudo[83983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:07 devstack sudo[83983]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-31498293-3985-4ed0-8763-75b69749566f tempest-GroupSnapshotsTest-1762123974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-367a3087-350d-4419-9f01-4e1152cd4517.info" returned: 0 in 0.633s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-31498293-3985-4ed0-8763-75b69749566f tempest-GroupSnapshotsTest-1762123974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.107s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:46:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-31498293-3985-4ed0-8763-75b69749566f tempest-GroupSnapshotsTest-1762123974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:46:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-31498293-3985-4ed0-8763-75b69749566f tempest-GroupSnapshotsTest-1762123974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:46:07 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-31498293-3985-4ed0-8763-75b69749566f tempest-GroupSnapshotsTest-1762123974 None] Creating offline snapshot a9f8ef2f-6f60-44a5-a730-a6c9ba0dfb11 of volume 30d5dad2-1201-4854-a5f1-1f0d1f8ac811 {{(pid=82046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 13:46:07 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[e187c4d7-bb77-47cb-94ca-de2972be0614]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:46:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-31498293-3985-4ed0-8763-75b69749566f tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:07 devstack sudo[83986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811 Apr 24 13:46:07 devstack sudo[83986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:08 devstack sudo[83986]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-31498293-3985-4ed0-8763-75b69749566f tempest-GroupSnapshotsTest-1762123974 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811" returned: 0 in 0.958s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-31498293-3985-4ed0-8763-75b69749566f tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811.a9f8ef2f-6f60-44a5-a730-a6c9ba0dfb11 1G {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:08 devstack sudo[83992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811.a9f8ef2f-6f60-44a5-a730-a6c9ba0dfb11 1G Apr 24 13:46:08 devstack sudo[83992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:09 devstack sudo[83992]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-31498293-3985-4ed0-8763-75b69749566f tempest-GroupSnapshotsTest-1762123974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811.a9f8ef2f-6f60-44a5-a730-a6c9ba0dfb11 1G" returned: 0 in 0.967s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-31498293-3985-4ed0-8763-75b69749566f tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811.a9f8ef2f-6f60-44a5-a730-a6c9ba0dfb11 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:09 devstack sudo[84013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811.a9f8ef2f-6f60-44a5-a730-a6c9ba0dfb11 Apr 24 13:46:09 devstack sudo[84013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:09 devstack sudo[84013]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-31498293-3985-4ed0-8763-75b69749566f tempest-GroupSnapshotsTest-1762123974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811.a9f8ef2f-6f60-44a5-a730-a6c9ba0dfb11" returned: 0 in 0.674s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:09 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-31498293-3985-4ed0-8763-75b69749566f tempest-GroupSnapshotsTest-1762123974 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811.a9f8ef2f-6f60-44a5-a730-a6c9ba0dfb11 is being set with open permissions: ugo+rw: NotImplementedError Apr 24 13:46:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-31498293-3985-4ed0-8763-75b69749566f tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811.a9f8ef2f-6f60-44a5-a730-a6c9ba0dfb11 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:09 devstack sudo[84022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811.a9f8ef2f-6f60-44a5-a730-a6c9ba0dfb11 Apr 24 13:46:09 devstack sudo[84022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:10 devstack sudo[84022]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:10 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-31498293-3985-4ed0-8763-75b69749566f tempest-GroupSnapshotsTest-1762123974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811.a9f8ef2f-6f60-44a5-a730-a6c9ba0dfb11" returned: 0 in 0.531s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:10 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-31498293-3985-4ed0-8763-75b69749566f tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:10 devstack sudo[84027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811.info Apr 24 13:46:10 devstack sudo[84027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:11 devstack sudo[84027]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-31498293-3985-4ed0-8763-75b69749566f tempest-GroupSnapshotsTest-1762123974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811.info" returned: 0 in 0.596s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:11 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-31498293-3985-4ed0-8763-75b69749566f tempest-GroupSnapshotsTest-1762123974 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811.info is being set with open permissions: ugo+rw: NotImplementedError Apr 24 13:46:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-31498293-3985-4ed0-8763-75b69749566f tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:11 devstack sudo[84030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811.info Apr 24 13:46:11 devstack sudo[84030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:11 devstack sudo[84030]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-31498293-3985-4ed0-8763-75b69749566f tempest-GroupSnapshotsTest-1762123974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811.info" returned: 0 in 0.560s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-31498293-3985-4ed0-8763-75b69749566f tempest-GroupSnapshotsTest-1762123974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.434s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:46:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b1b658ff-d37d-4549-a39f-13bbfb52be34 tempest-GroupsV314Test-191084596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.724s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:46:11 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b1b658ff-d37d-4549-a39f-13bbfb52be34 tempest-GroupsV314Test-191084596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=35acf07c-d3a7-4aa9-9ef7-3c35b212549b,created_at=2026-04-24T11:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1749251274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=35acf07c-d3a7-4aa9-9ef7-3c35b212549b,host='devstack@QuobyteHD#QuobyteHD',id=860e4488-5acc-45e1-9a1d-2f553ce53dad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed39270e175f4d418812899707bfb417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:46:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:46:03Z,use_quota=True,user_id='a14f02e5f8f1417785246bd7e5d1ba4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9dc0db5-18c7-4deb-941b-6b185d3e70e1),volume_type_id=d9dc0db5-18c7-4deb-941b-6b185d3e70e1)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:46:11 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-b1b658ff-d37d-4549-a39f-13bbfb52be34 tempest-GroupsV314Test-191084596 None] Creating volume 860e4488-5acc-45e1-9a1d-2f553ce53dad {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:46:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b1b658ff-d37d-4549-a39f-13bbfb52be34 tempest-GroupsV314Test-191084596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:46:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b1b658ff-d37d-4549-a39f-13bbfb52be34 tempest-GroupsV314Test-191084596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:46:11 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b1b658ff-d37d-4549-a39f-13bbfb52be34 tempest-GroupsV314Test-191084596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:46:11 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b1b658ff-d37d-4549-a39f-13bbfb52be34 tempest-GroupsV314Test-191084596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:46:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b1b658ff-d37d-4549-a39f-13bbfb52be34 tempest-GroupsV314Test-191084596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:46:11 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b1b658ff-d37d-4549-a39f-13bbfb52be34 tempest-GroupsV314Test-191084596 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:46:11 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-b1b658ff-d37d-4549-a39f-13bbfb52be34 tempest-GroupsV314Test-191084596 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:46:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b1b658ff-d37d-4549-a39f-13bbfb52be34 tempest-GroupsV314Test-191084596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:11 devstack sudo[84033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad 1073741824 Apr 24 13:46:11 devstack sudo[84033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:11 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-31498293-3985-4ed0-8763-75b69749566f tempest-GroupSnapshotsTest-1762123974 None] group_snapshot 8a927a6c-baf2-4cac-945c-b89517604082: created successfully Apr 24 13:46:12 devstack sudo[84033]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b1b658ff-d37d-4549-a39f-13bbfb52be34 tempest-GroupsV314Test-191084596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad 1073741824" returned: 0 in 0.840s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b1b658ff-d37d-4549-a39f-13bbfb52be34 tempest-GroupsV314Test-191084596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:12 devstack sudo[84041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad Apr 24 13:46:12 devstack sudo[84041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:12 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-3497be00-e76d-4515-84d3-7f2865226bfb tempest-GroupSnapshotsTest-1762123974 None] group_snapshot 8a927a6c-baf2-4cac-945c-b89517604082: deleting Apr 24 13:46:12 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-3497be00-e76d-4515-84d3-7f2865226bfb tempest-GroupSnapshotsTest-1762123974 None] group_snapshot 8a927a6c-baf2-4cac-945c-b89517604082: deleting {{(pid=82046) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 24 13:46:12 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-3497be00-e76d-4515-84d3-7f2865226bfb tempest-GroupSnapshotsTest-1762123974 None] Acquiring lock "cinder-quobyte-367a3087-350d-4419-9f01-4e1152cd4517" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:46:13 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-3497be00-e76d-4515-84d3-7f2865226bfb tempest-GroupSnapshotsTest-1762123974 None] Lock "cinder-quobyte-367a3087-350d-4419-9f01-4e1152cd4517" acquired by "delete_snapshot" :: waited 0.059s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:46:13 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-3497be00-e76d-4515-84d3-7f2865226bfb tempest-GroupSnapshotsTest-1762123974 None] Acquiring lock "cinder-quobyte-a364e218-c1bb-4029-abb2-275167d571d7" by "_delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:46:13 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-3497be00-e76d-4515-84d3-7f2865226bfb tempest-GroupSnapshotsTest-1762123974 None] Lock "cinder-quobyte-a364e218-c1bb-4029-abb2-275167d571d7" acquired by "_delete_snapshot" :: waited 0.066s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:46:13 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-3497be00-e76d-4515-84d3-7f2865226bfb tempest-GroupSnapshotsTest-1762123974 None] Deleting offline snapshot a364e218-c1bb-4029-abb2-275167d571d7 of volume 367a3087-350d-4419-9f01-4e1152cd4517 {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 13:46:13 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-3497be00-e76d-4515-84d3-7f2865226bfb tempest-GroupSnapshotsTest-1762123974 None] snapshot_file for this snap is: volume-367a3087-350d-4419-9f01-4e1152cd4517.a364e218-c1bb-4029-abb2-275167d571d7 {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 13:46:13 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0eb313-82d1-4302-b804-840bba1ab612]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:46:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3497be00-e76d-4515-84d3-7f2865226bfb tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-367a3087-350d-4419-9f01-4e1152cd4517.a364e218-c1bb-4029-abb2-275167d571d7 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:13 devstack sudo[84041]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b1b658ff-d37d-4549-a39f-13bbfb52be34 tempest-GroupsV314Test-191084596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad" returned: 0 in 0.723s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:13 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b1b658ff-d37d-4549-a39f-13bbfb52be34 tempest-GroupsV314Test-191084596 None] <== create_volume: return (1602ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:46:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b1b658ff-d37d-4549-a39f-13bbfb52be34 tempest-GroupsV314Test-191084596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.604s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:46:13 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b1b658ff-d37d-4549-a39f-13bbfb52be34 tempest-GroupsV314Test-191084596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c136d1e-4f90-4b1c-852c-2b9a0f79112c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-860e4488-5acc-45e1-9a1d-2f553ce53dad', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:46:13 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b1b658ff-d37d-4549-a39f-13bbfb52be34 tempest-GroupsV314Test-191084596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa1afe75-b215-43a2-a47d-42982a7e6a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:46:13 devstack sudo[84076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-367a3087-350d-4419-9f01-4e1152cd4517.a364e218-c1bb-4029-abb2-275167d571d7 Apr 24 13:46:13 devstack sudo[84076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:13 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-b1b658ff-d37d-4549-a39f-13bbfb52be34 tempest-GroupsV314Test-191084596 None] Volume volume-860e4488-5acc-45e1-9a1d-2f553ce53dad (860e4488-5acc-45e1-9a1d-2f553ce53dad): created successfully Apr 24 13:46:13 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b1b658ff-d37d-4549-a39f-13bbfb52be34 tempest-GroupsV314Test-191084596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa1afe75-b215-43a2-a47d-42982a7e6a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:46:13 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b1b658ff-d37d-4549-a39f-13bbfb52be34 tempest-GroupsV314Test-191084596 None] Flow 'volume_create_manager' (270ba894-2819-4688-903b-9a67b505725e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:46:13 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-b1b658ff-d37d-4549-a39f-13bbfb52be34 tempest-GroupsV314Test-191084596 None] Created volume successfully. Apr 24 13:46:13 devstack sudo[84076]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3497be00-e76d-4515-84d3-7f2865226bfb tempest-GroupSnapshotsTest-1762123974 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-367a3087-350d-4419-9f01-4e1152cd4517.a364e218-c1bb-4029-abb2-275167d571d7" returned: 0 in 0.657s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:13 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-3497be00-e76d-4515-84d3-7f2865226bfb tempest-GroupSnapshotsTest-1762123974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-367a3087-350d-4419-9f01-4e1152cd4517(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:46:13 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb27c5b1-7565-4372-9cc2-9fbbada93e88]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:46:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3497be00-e76d-4515-84d3-7f2865226bfb tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-367a3087-350d-4419-9f01-4e1152cd4517 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:13 devstack sudo[84083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-367a3087-350d-4419-9f01-4e1152cd4517 Apr 24 13:46:13 devstack sudo[84083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:14 devstack sudo[84083]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3497be00-e76d-4515-84d3-7f2865226bfb tempest-GroupSnapshotsTest-1762123974 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-367a3087-350d-4419-9f01-4e1152cd4517" returned: 0 in 0.826s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3497be00-e76d-4515-84d3-7f2865226bfb tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-367a3087-350d-4419-9f01-4e1152cd4517.a364e218-c1bb-4029-abb2-275167d571d7 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:14 devstack sudo[84095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-367a3087-350d-4419-9f01-4e1152cd4517.a364e218-c1bb-4029-abb2-275167d571d7 Apr 24 13:46:14 devstack sudo[84095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:46:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.004s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:46:15 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] Cloning volume 860e4488-5acc-45e1-9a1d-2f553ce53dad to volume 010cb9ba-b6ce-4e36-a44c-77b5d4436357 Apr 24 13:46:15 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] Creating offline snapshot 94e247d6-3418-4ff6-a3cc-2a9b6c6cc820 of volume 860e4488-5acc-45e1-9a1d-2f553ce53dad {{(pid=82046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 13:46:15 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[46137d32-6b8b-4254-9590-452ac647585e]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:46:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:15 devstack sudo[84124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad Apr 24 13:46:15 devstack sudo[84124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:16 devstack sudo[84095]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:16 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3497be00-e76d-4515-84d3-7f2865226bfb tempest-GroupSnapshotsTest-1762123974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-367a3087-350d-4419-9f01-4e1152cd4517.a364e218-c1bb-4029-abb2-275167d571d7" returned: 0 in 1.509s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:16 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3497be00-e76d-4515-84d3-7f2865226bfb tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-367a3087-350d-4419-9f01-4e1152cd4517.a364e218-c1bb-4029-abb2-275167d571d7 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:16 devstack sudo[84140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-367a3087-350d-4419-9f01-4e1152cd4517.a364e218-c1bb-4029-abb2-275167d571d7 Apr 24 13:46:16 devstack sudo[84140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:16 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [req-1d150829-834d-4a4b-804c-f79c4bcfd840 req-18acef1c-53ef-4ab4-b6e8-7a357adce841 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:46:17 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-1d150829-834d-4a4b-804c-f79c4bcfd840 req-18acef1c-53ef-4ab4-b6e8-7a357adce841 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Flow 'volume_create_manager' (ccde575c-626d-4952-aa5a-1de28367e900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:46:17 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-1d150829-834d-4a4b-804c-f79c4bcfd840 req-18acef1c-53ef-4ab4-b6e8-7a357adce841 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3947c534-4cc7-400a-8587-75604b112acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:46:17 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-1d150829-834d-4a4b-804c-f79c4bcfd840 req-18acef1c-53ef-4ab4-b6e8-7a357adce841 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3947c534-4cc7-400a-8587-75604b112acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:46:16Z,deleted=False,deleted_at=None,display_description='',display_name='9723cee9-030b-4569-90f9-15eb52c0d355-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2ed9936-b1c0-4ddf-bd6a-fc6713c3cb60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fc671775a304cc789bb9beb3b8ba47b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:46:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:46:17Z,use_quota=True,user_id='52bc9aff0b104aa19ab83685ea6380f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:46:17 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-1d150829-834d-4a4b-804c-f79c4bcfd840 req-18acef1c-53ef-4ab4-b6e8-7a357adce841 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7589751-a0bf-46bc-863a-bf9874e8c027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:46:17 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-1d150829-834d-4a4b-804c-f79c4bcfd840 req-18acef1c-53ef-4ab4-b6e8-7a357adce841 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7589751-a0bf-46bc-863a-bf9874e8c027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:46:17 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-1d150829-834d-4a4b-804c-f79c4bcfd840 req-18acef1c-53ef-4ab4-b6e8-7a357adce841 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6447f513-b859-4a05-9826-17f33be71963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:46:17 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-1d150829-834d-4a4b-804c-f79c4bcfd840 req-18acef1c-53ef-4ab4-b6e8-7a357adce841 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6447f513-b859-4a05-9826-17f33be71963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2ed9936-b1c0-4ddf-bd6a-fc6713c3cb60', 'volume_name': 'volume-a2ed9936-b1c0-4ddf-bd6a-fc6713c3cb60', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:46:17 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-1d150829-834d-4a4b-804c-f79c4bcfd840 req-18acef1c-53ef-4ab4-b6e8-7a357adce841 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98c9f553-8074-49d2-a019-1ca6530c745f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:46:17 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-1d150829-834d-4a4b-804c-f79c4bcfd840 req-18acef1c-53ef-4ab4-b6e8-7a357adce841 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98c9f553-8074-49d2-a019-1ca6530c745f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:46:17 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-1d150829-834d-4a4b-804c-f79c4bcfd840 req-18acef1c-53ef-4ab4-b6e8-7a357adce841 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b5c35df-3e9e-4d1e-a02f-67526a5ac05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:46:17 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [req-1d150829-834d-4a4b-804c-f79c4bcfd840 req-18acef1c-53ef-4ab4-b6e8-7a357adce841 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Volume a2ed9936-b1c0-4ddf-bd6a-fc6713c3cb60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2ed9936-b1c0-4ddf-bd6a-fc6713c3cb60', 'volume_size': 1} Apr 24 13:46:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [req-1d150829-834d-4a4b-804c-f79c4bcfd840 req-18acef1c-53ef-4ab4-b6e8-7a357adce841 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:46:17 devstack sudo[84124]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad" returned: 0 in 1.542s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad.94e247d6-3418-4ff6-a3cc-2a9b6c6cc820 1G {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:17 devstack sudo[84148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad.94e247d6-3418-4ff6-a3cc-2a9b6c6cc820 1G Apr 24 13:46:17 devstack sudo[84148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:17 devstack sudo[84140]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3497be00-e76d-4515-84d3-7f2865226bfb tempest-GroupSnapshotsTest-1762123974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-367a3087-350d-4419-9f01-4e1152cd4517.a364e218-c1bb-4029-abb2-275167d571d7" returned: 0 in 1.502s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:17 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-3497be00-e76d-4515-84d3-7f2865226bfb tempest-GroupSnapshotsTest-1762123974 None] Lock "cinder-quobyte-a364e218-c1bb-4029-abb2-275167d571d7" released by "_delete_snapshot" :: held 4.633s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:46:17 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-3497be00-e76d-4515-84d3-7f2865226bfb tempest-GroupSnapshotsTest-1762123974 None] Lock "cinder-quobyte-367a3087-350d-4419-9f01-4e1152cd4517" released by "delete_snapshot" :: held 4.708s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:46:17 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-3497be00-e76d-4515-84d3-7f2865226bfb tempest-GroupSnapshotsTest-1762123974 None] Acquiring lock "cinder-quobyte-30d5dad2-1201-4854-a5f1-1f0d1f8ac811" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:46:17 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-3497be00-e76d-4515-84d3-7f2865226bfb tempest-GroupSnapshotsTest-1762123974 None] Lock "cinder-quobyte-30d5dad2-1201-4854-a5f1-1f0d1f8ac811" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:46:17 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-3497be00-e76d-4515-84d3-7f2865226bfb tempest-GroupSnapshotsTest-1762123974 None] Acquiring lock "cinder-quobyte-a9f8ef2f-6f60-44a5-a730-a6c9ba0dfb11" by "_delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:46:17 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-3497be00-e76d-4515-84d3-7f2865226bfb tempest-GroupSnapshotsTest-1762123974 None] Lock "cinder-quobyte-a9f8ef2f-6f60-44a5-a730-a6c9ba0dfb11" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:46:17 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-3497be00-e76d-4515-84d3-7f2865226bfb tempest-GroupSnapshotsTest-1762123974 None] Deleting offline snapshot a9f8ef2f-6f60-44a5-a730-a6c9ba0dfb11 of volume 30d5dad2-1201-4854-a5f1-1f0d1f8ac811 {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 13:46:17 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-3497be00-e76d-4515-84d3-7f2865226bfb tempest-GroupSnapshotsTest-1762123974 None] snapshot_file for this snap is: volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811.a9f8ef2f-6f60-44a5-a730-a6c9ba0dfb11 {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 13:46:17 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d8cdea-7a5d-4faa-9874-1e3542ac2352]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:46:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3497be00-e76d-4515-84d3-7f2865226bfb tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811.a9f8ef2f-6f60-44a5-a730-a6c9ba0dfb11 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:17 devstack sudo[84152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811.a9f8ef2f-6f60-44a5-a730-a6c9ba0dfb11 Apr 24 13:46:17 devstack sudo[84152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:19 devstack sudo[84152]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:19 devstack sudo[84148]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3497be00-e76d-4515-84d3-7f2865226bfb tempest-GroupSnapshotsTest-1762123974 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811.a9f8ef2f-6f60-44a5-a730-a6c9ba0dfb11" returned: 0 in 1.236s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:19 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-3497be00-e76d-4515-84d3-7f2865226bfb tempest-GroupSnapshotsTest-1762123974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:46:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad.94e247d6-3418-4ff6-a3cc-2a9b6c6cc820 1G" returned: 0 in 1.798s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-860e4488-5acc-45e1-9a1d-2f553ce53dad -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad.94e247d6-3418-4ff6-a3cc-2a9b6c6cc820 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:19 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6f23b1-68ed-4f95-8f04-577d86660458]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:46:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3497be00-e76d-4515-84d3-7f2865226bfb tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:19 devstack sudo[84162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-860e4488-5acc-45e1-9a1d-2f553ce53dad -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad.94e247d6-3418-4ff6-a3cc-2a9b6c6cc820 Apr 24 13:46:19 devstack sudo[84162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:19 devstack sudo[84163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811 Apr 24 13:46:19 devstack sudo[84163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:19 devstack sudo[84163]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3497be00-e76d-4515-84d3-7f2865226bfb tempest-GroupSnapshotsTest-1762123974 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811" returned: 0 in 0.784s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3497be00-e76d-4515-84d3-7f2865226bfb tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811.a9f8ef2f-6f60-44a5-a730-a6c9ba0dfb11 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:19 devstack sudo[84172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811.a9f8ef2f-6f60-44a5-a730-a6c9ba0dfb11 Apr 24 13:46:19 devstack sudo[84172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:20 devstack sudo[84162]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-860e4488-5acc-45e1-9a1d-2f553ce53dad -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad.94e247d6-3418-4ff6-a3cc-2a9b6c6cc820" returned: 0 in 0.942s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:20 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad.94e247d6-3418-4ff6-a3cc-2a9b6c6cc820 is being set with open permissions: ugo+rw: NotImplementedError Apr 24 13:46:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad.94e247d6-3418-4ff6-a3cc-2a9b6c6cc820 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:20 devstack sudo[84174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad.94e247d6-3418-4ff6-a3cc-2a9b6c6cc820 Apr 24 13:46:20 devstack sudo[84174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:20 devstack sudo[84174]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad.94e247d6-3418-4ff6-a3cc-2a9b6c6cc820" returned: 0 in 0.658s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:20 devstack sudo[84172]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3497be00-e76d-4515-84d3-7f2865226bfb tempest-GroupSnapshotsTest-1762123974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811.a9f8ef2f-6f60-44a5-a730-a6c9ba0dfb11" returned: 0 in 0.862s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3497be00-e76d-4515-84d3-7f2865226bfb tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811.a9f8ef2f-6f60-44a5-a730-a6c9ba0dfb11 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:20 devstack sudo[84182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad.info Apr 24 13:46:20 devstack sudo[84182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:20 devstack sudo[84183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811.a9f8ef2f-6f60-44a5-a730-a6c9ba0dfb11 Apr 24 13:46:20 devstack sudo[84183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:21 devstack sudo[84182]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad.info" returned: 0 in 0.829s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:21 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad.info is being set with open permissions: ugo+rw: NotImplementedError Apr 24 13:46:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:21 devstack sudo[84183]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3497be00-e76d-4515-84d3-7f2865226bfb tempest-GroupSnapshotsTest-1762123974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811.a9f8ef2f-6f60-44a5-a730-a6c9ba0dfb11" returned: 0 in 0.826s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:21 devstack sudo[84192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad.info Apr 24 13:46:21 devstack sudo[84192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:21 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-3497be00-e76d-4515-84d3-7f2865226bfb tempest-GroupSnapshotsTest-1762123974 None] Lock "cinder-quobyte-a9f8ef2f-6f60-44a5-a730-a6c9ba0dfb11" released by "_delete_snapshot" :: held 3.891s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:46:21 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-3497be00-e76d-4515-84d3-7f2865226bfb tempest-GroupSnapshotsTest-1762123974 None] Lock "cinder-quobyte-30d5dad2-1201-4854-a5f1-1f0d1f8ac811" released by "delete_snapshot" :: held 3.939s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:46:21 devstack cinder-volume[82046]: WARNING cinder.quota [None req-3497be00-e76d-4515-84d3-7f2865226bfb tempest-GroupSnapshotsTest-1762123974 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-985994683 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-985994683, it is now deprecated. Please use the default quota class for default quota. Apr 24 13:46:21 devstack cinder-volume[82046]: WARNING cinder.quota [None req-3497be00-e76d-4515-84d3-7f2865226bfb tempest-GroupSnapshotsTest-1762123974 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-985994683 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-985994683, it is now deprecated. Please use the default quota class for default quota. Apr 24 13:46:21 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-3497be00-e76d-4515-84d3-7f2865226bfb tempest-GroupSnapshotsTest-1762123974 None] Created reservations ['7ddf8efe-44c4-4656-96d6-80ae3dbe4048', '1b64b199-2b07-4a16-a884-d8034f38c83e', '92e80815-5a8e-49ba-b93a-1be2e136edee', '8948e120-967b-4e81-90ad-f25218e3f8aa'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:46:22 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-3497be00-e76d-4515-84d3-7f2865226bfb tempest-GroupSnapshotsTest-1762123974 None] Created reservations ['b1a8d6ce-4ede-4a02-875f-d606ed7966de', '3a8e9027-632b-4d53-8b72-722d9b8f5bae', '63ba7f6b-6d04-422f-b36f-6e5ab93dc14d', '019f430d-2273-4f4d-9a46-38ae65d63d78'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:46:22 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-3497be00-e76d-4515-84d3-7f2865226bfb tempest-GroupSnapshotsTest-1762123974 None] group_snapshot 8a927a6c-baf2-4cac-945c-b89517604082: deleted successfully Apr 24 13:46:22 devstack sudo[84192]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad.info" returned: 0 in 0.764s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:22 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] Acquiring lock "cinder-quobyte-010cb9ba-b6ce-4e36-a44c-77b5d4436357" by "_copy_volume_from_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:46:22 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] Lock "cinder-quobyte-010cb9ba-b6ce-4e36-a44c-77b5d4436357" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:46:22 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] snapshot: 94e247d6-3418-4ff6-a3cc-2a9b6c6cc820, volume: 010cb9ba-b6ce-4e36-a44c-77b5d4436357, {{(pid=82046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 13:46:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:46:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:46:22 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:46:22 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:46:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:46:22 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5db505-eacc-4fdd-a6ff-5fc72f7dc0f0]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:46:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad.94e247d6-3418-4ff6-a3cc-2a9b6c6cc820 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:22 devstack sudo[84195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad.94e247d6-3418-4ff6-a3cc-2a9b6c6cc820 Apr 24 13:46:22 devstack sudo[84195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:23 devstack sudo[84195]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:23 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad.94e247d6-3418-4ff6-a3cc-2a9b6c6cc820" returned: 0 in 0.791s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:23 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-860e4488-5acc-45e1-9a1d-2f553ce53dad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:46:23 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad {{(pid=82046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 13:46:23 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] Creating direct copy from snapshot {{(pid=82046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 13:46:23 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d77b553-da5d-4f05-ae68-a1128240fc5d]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:46:23 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:23 devstack sudo[84202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad Apr 24 13:46:23 devstack sudo[84202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:23 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-bd3c4077-5566-4b09-a794-4651c422f885 tempest-GroupSnapshotsTest-1762123974 None] Acquiring lock "cinder-quobyte-30d5dad2-1201-4854-a5f1-1f0d1f8ac811" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:46:23 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-bd3c4077-5566-4b09-a794-4651c422f885 tempest-GroupSnapshotsTest-1762123974 None] Lock "cinder-quobyte-30d5dad2-1201-4854-a5f1-1f0d1f8ac811" acquired by "delete_volume" :: waited 0.025s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:46:23 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3132c5-009f-474c-b3c8-8a45c13c1592]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:46:23 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bd3c4077-5566-4b09-a794-4651c422f885 tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:23 devstack sudo[84204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811 Apr 24 13:46:23 devstack sudo[84204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:23 devstack sudo[84202]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:23 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad" returned: 0 in 0.672s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:23 devstack cinder-volume[82046]: DEBUG cinder.utils [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] Path /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-010cb9ba-b6ce-4e36-a44c-77b5d4436357 not found in is_blk_device check {{(pid=82046) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 13:46:23 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-010cb9ba-b6ce-4e36-a44c-77b5d4436357 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:23 devstack sudo[84209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-010cb9ba-b6ce-4e36-a44c-77b5d4436357 Apr 24 13:46:23 devstack sudo[84209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:24 devstack sudo[84204]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bd3c4077-5566-4b09-a794-4651c422f885 tempest-GroupSnapshotsTest-1762123974 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811" returned: 0 in 0.917s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bd3c4077-5566-4b09-a794-4651c422f885 tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:24 devstack sudo[84214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811 Apr 24 13:46:24 devstack sudo[84214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:25 devstack sudo[84214]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:25 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bd3c4077-5566-4b09-a794-4651c422f885 tempest-GroupSnapshotsTest-1762123974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30d5dad2-1201-4854-a5f1-1f0d1f8ac811" returned: 0 in 0.965s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:25 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-bd3c4077-5566-4b09-a794-4651c422f885 tempest-GroupSnapshotsTest-1762123974 None] Lock "cinder-quobyte-30d5dad2-1201-4854-a5f1-1f0d1f8ac811" released by "delete_volume" :: held 1.968s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:46:25 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-bd3c4077-5566-4b09-a794-4651c422f885 tempest-GroupSnapshotsTest-1762123974 None] Acquiring lock "cinder-quobyte-367a3087-350d-4419-9f01-4e1152cd4517" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:46:25 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-bd3c4077-5566-4b09-a794-4651c422f885 tempest-GroupSnapshotsTest-1762123974 None] Lock "cinder-quobyte-367a3087-350d-4419-9f01-4e1152cd4517" acquired by "delete_volume" :: waited 0.031s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:46:25 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee9eb9c-497e-4bbd-a40f-b1493694feb7]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:46:25 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bd3c4077-5566-4b09-a794-4651c422f885 tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-367a3087-350d-4419-9f01-4e1152cd4517 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:26 devstack sudo[84228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-367a3087-350d-4419-9f01-4e1152cd4517 Apr 24 13:46:26 devstack sudo[84228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:28 devstack sudo[84228]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bd3c4077-5566-4b09-a794-4651c422f885 tempest-GroupSnapshotsTest-1762123974 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-367a3087-350d-4419-9f01-4e1152cd4517" returned: 0 in 2.810s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bd3c4077-5566-4b09-a794-4651c422f885 tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-367a3087-350d-4419-9f01-4e1152cd4517 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:28 devstack sudo[84234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-367a3087-350d-4419-9f01-4e1152cd4517 Apr 24 13:46:28 devstack sudo[84234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:30 devstack sudo[84234]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bd3c4077-5566-4b09-a794-4651c422f885 tempest-GroupSnapshotsTest-1762123974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-367a3087-350d-4419-9f01-4e1152cd4517" returned: 0 in 1.770s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:30 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-bd3c4077-5566-4b09-a794-4651c422f885 tempest-GroupSnapshotsTest-1762123974 None] Lock "cinder-quobyte-367a3087-350d-4419-9f01-4e1152cd4517" released by "delete_volume" :: held 4.820s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:46:30 devstack cinder-volume[82046]: DEBUG dbcounter [-] [82046] Writing DB stats cinder:SELECT=83,cinder:UPDATE=93,cinder:INSERT=25,cinder:DELETE=2 {{(pid=82046) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 13:46:30 devstack cinder-volume[82046]: DEBUG dbcounter [-] [82046] Writing DB stats cinder:SELECT=107,cinder:UPDATE=82,cinder:DELETE=3,cinder:INSERT=15 {{(pid=82046) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 13:46:30 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-bd3c4077-5566-4b09-a794-4651c422f885 tempest-GroupSnapshotsTest-1762123974 None] Created reservations ['b2543af1-58d1-402e-bfdc-2cae0afafdd8'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:46:30 devstack cinder-volume[82046]: WARNING cinder.quota [None req-bd3c4077-5566-4b09-a794-4651c422f885 tempest-GroupSnapshotsTest-1762123974 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-985994683 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-985994683, it is now deprecated. Please use the default quota class for default quota. Apr 24 13:46:30 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-bd3c4077-5566-4b09-a794-4651c422f885 tempest-GroupSnapshotsTest-1762123974 None] Created reservations ['52444dbd-212e-4648-b9fc-ed050c039743', 'd1040fed-34f5-4a08-830a-ada7b646b077', '6b1df43f-57ad-4dd0-9d61-4aa80890680b', '94b7ea64-fa0c-43cd-9d75-24f62eb6232e'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:46:31 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-bd3c4077-5566-4b09-a794-4651c422f885 tempest-GroupSnapshotsTest-1762123974 None] Created reservations ['050a094d-b92a-471f-9f6f-b1633aec8bc3', 'ab1ce7cf-44c1-4336-a2b0-f8f911ce551d', '222bc412-acd0-4a6e-b5bf-125bc640a978', '7b2a8b86-a37f-4f93-8360-ca63bd9fde1f'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:46:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-bd3c4077-5566-4b09-a794-4651c422f885 tempest-GroupSnapshotsTest-1762123974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:46:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-bd3c4077-5566-4b09-a794-4651c422f885 tempest-GroupSnapshotsTest-1762123974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:46:31 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-bd3c4077-5566-4b09-a794-4651c422f885 tempest-GroupSnapshotsTest-1762123974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:46:31 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-bd3c4077-5566-4b09-a794-4651c422f885 tempest-GroupSnapshotsTest-1762123974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:46:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-bd3c4077-5566-4b09-a794-4651c422f885 tempest-GroupSnapshotsTest-1762123974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:46:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bd3c4077-5566-4b09-a794-4651c422f885 tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:31 devstack sudo[84282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:46:31 devstack sudo[84282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:32 devstack sudo[84282]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bd3c4077-5566-4b09-a794-4651c422f885 tempest-GroupSnapshotsTest-1762123974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 1.041s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:32 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-bd3c4077-5566-4b09-a794-4651c422f885 tempest-GroupSnapshotsTest-1762123974 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:46:32 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-bd3c4077-5566-4b09-a794-4651c422f885 tempest-GroupSnapshotsTest-1762123974 None] Delete group completed successfully. Apr 24 13:46:32 devstack sudo[84209]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-010cb9ba-b6ce-4e36-a44c-77b5d4436357" returned: 0 in 9.039s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:33 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2382f9-cb5a-48cc-b692-3752acedfa5d]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:46:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:33 devstack sudo[84289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad Apr 24 13:46:33 devstack sudo[84289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:33 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-5c5ee638-052d-47ab-9ceb-0085ad4e436a tempest-GroupSnapshotsTest-1762123974 None] Group tempest-GroupSnapshotsTest-Group-850929894: creating Apr 24 13:46:33 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-5c5ee638-052d-47ab-9ceb-0085ad4e436a tempest-GroupSnapshotsTest-1762123974 None] Group tempest-GroupSnapshotsTest-Group-850929894: created successfully Apr 24 13:46:33 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-5c5ee638-052d-47ab-9ceb-0085ad4e436a tempest-GroupSnapshotsTest-1762123974 None] Create group completed successfully. Apr 24 13:46:33 devstack sudo[84289]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad" returned: 0 in 0.714s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:33 devstack cinder-volume[82046]: DEBUG cinder.image.image_utils [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] Image conversion details: src /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad, size 1024.00 MB, duration 9.04 sec, destination /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-010cb9ba-b6ce-4e36-a44c-77b5d4436357 {{(pid=82046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 13:46:33 devstack cinder-volume[82046]: INFO cinder.image.image_utils [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] Converted 1024.00 MB image at 113.28 MB/s Apr 24 13:46:33 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-010cb9ba-b6ce-4e36-a44c-77b5d4436357 is being set with open permissions: ugo+rw: NotImplementedError Apr 24 13:46:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-010cb9ba-b6ce-4e36-a44c-77b5d4436357 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:33 devstack sudo[84295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-010cb9ba-b6ce-4e36-a44c-77b5d4436357 Apr 24 13:46:33 devstack sudo[84295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:34 devstack sudo[84295]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-010cb9ba-b6ce-4e36-a44c-77b5d4436357" returned: 0 in 0.488s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:34 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] Lock "cinder-quobyte-010cb9ba-b6ce-4e36-a44c-77b5d4436357" released by "_copy_volume_from_snapshot" :: held 11.844s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:46:34 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] Acquiring lock "cinder-quobyte-94e247d6-3418-4ff6-a3cc-2a9b6c6cc820" by "_delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:46:34 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] Lock "cinder-quobyte-94e247d6-3418-4ff6-a3cc-2a9b6c6cc820" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:46:34 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] Deleting offline snapshot 94e247d6-3418-4ff6-a3cc-2a9b6c6cc820 of volume 860e4488-5acc-45e1-9a1d-2f553ce53dad {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 13:46:34 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] snapshot_file for this snap is: volume-860e4488-5acc-45e1-9a1d-2f553ce53dad.94e247d6-3418-4ff6-a3cc-2a9b6c6cc820 {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 13:46:34 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[3910724f-0d74-4732-bd8f-073217d523ec]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:46:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad.94e247d6-3418-4ff6-a3cc-2a9b6c6cc820 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:34 devstack sudo[84298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad.94e247d6-3418-4ff6-a3cc-2a9b6c6cc820 Apr 24 13:46:34 devstack sudo[84298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:34 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bd62bd8-2362-46f4-b0a3-6c6c20c7490c tempest-GroupSnapshotsTest-1762123974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:46:34 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-3bd62bd8-2362-46f4-b0a3-6c6c20c7490c tempest-GroupSnapshotsTest-1762123974 None] Flow 'volume_create_manager' (7a7b2a12-5289-4b9b-a5ba-d9218c06f043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:46:34 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-3bd62bd8-2362-46f4-b0a3-6c6c20c7490c tempest-GroupSnapshotsTest-1762123974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a0eef9c-fce0-47d9-9989-77105978a2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:46:34 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-3bd62bd8-2362-46f4-b0a3-6c6c20c7490c tempest-GroupSnapshotsTest-1762123974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a0eef9c-fce0-47d9-9989-77105978a2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-161720533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6f72d1fb-74dd-478f-a19e-936867df8410,host='devstack@QuobyteHD#QuobyteHD',id=83e96f37-4d6a-48fa-8060-6fb3dace59d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4246a8fe8dcd4b2e9ca8333916bc2f43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:46:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:46:35Z,use_quota=True,user_id='d088ccb065cb430db99c689f055c7437',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e83f0bf9-1236-4965-9155-c423faca6a4b),volume_type_id=e83f0bf9-1236-4965-9155-c423faca6a4b)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:46:34 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-3bd62bd8-2362-46f4-b0a3-6c6c20c7490c tempest-GroupSnapshotsTest-1762123974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26d5ef76-c81c-4c22-9f11-f877509be9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:46:34 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-3bd62bd8-2362-46f4-b0a3-6c6c20c7490c tempest-GroupSnapshotsTest-1762123974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26d5ef76-c81c-4c22-9f11-f877509be9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:46:34 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-3bd62bd8-2362-46f4-b0a3-6c6c20c7490c tempest-GroupSnapshotsTest-1762123974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fee3f21-83f0-44b8-85bc-a6b77e93dc66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:46:34 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-3bd62bd8-2362-46f4-b0a3-6c6c20c7490c tempest-GroupSnapshotsTest-1762123974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fee3f21-83f0-44b8-85bc-a6b77e93dc66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83e96f37-4d6a-48fa-8060-6fb3dace59d8', 'volume_name': 'volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:46:34 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-3bd62bd8-2362-46f4-b0a3-6c6c20c7490c tempest-GroupSnapshotsTest-1762123974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f366634-7586-4ebf-b72b-b832c936a422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:46:34 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-3bd62bd8-2362-46f4-b0a3-6c6c20c7490c tempest-GroupSnapshotsTest-1762123974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f366634-7586-4ebf-b72b-b832c936a422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:46:34 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-3bd62bd8-2362-46f4-b0a3-6c6c20c7490c tempest-GroupSnapshotsTest-1762123974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f8072ee-28ce-4184-ba6a-59b3c9d0f77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:46:34 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-3bd62bd8-2362-46f4-b0a3-6c6c20c7490c tempest-GroupSnapshotsTest-1762123974 None] Volume 83e96f37-4d6a-48fa-8060-6fb3dace59d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8', 'volume_size': 1} Apr 24 13:46:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-3bd62bd8-2362-46f4-b0a3-6c6c20c7490c tempest-GroupSnapshotsTest-1762123974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:46:34 devstack sudo[84298]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad.94e247d6-3418-4ff6-a3cc-2a9b6c6cc820" returned: 0 in 0.651s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:34 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-860e4488-5acc-45e1-9a1d-2f553ce53dad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:46:35 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e578937-7d62-44a2-b267-c5a594adff2d]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:46:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:35 devstack sudo[84303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad Apr 24 13:46:35 devstack sudo[84303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:35 devstack sudo[84303]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad" returned: 0 in 0.619s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad.94e247d6-3418-4ff6-a3cc-2a9b6c6cc820 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:35 devstack sudo[84309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad.94e247d6-3418-4ff6-a3cc-2a9b6c6cc820 Apr 24 13:46:35 devstack sudo[84309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:36 devstack sudo[84309]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad.94e247d6-3418-4ff6-a3cc-2a9b6c6cc820" returned: 0 in 0.620s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad.94e247d6-3418-4ff6-a3cc-2a9b6c6cc820 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:36 devstack sudo[84318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad.94e247d6-3418-4ff6-a3cc-2a9b6c6cc820 Apr 24 13:46:36 devstack sudo[84318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:36 devstack sudo[84318]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad.94e247d6-3418-4ff6-a3cc-2a9b6c6cc820" returned: 0 in 0.510s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:36 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] Lock "cinder-quobyte-94e247d6-3418-4ff6-a3cc-2a9b6c6cc820" released by "_delete_snapshot" :: held 2.534s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:46:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 21.189s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:46:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [req-1d150829-834d-4a4b-804c-f79c4bcfd840 req-18acef1c-53ef-4ab4-b6e8-7a357adce841 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.783s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:46:36 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [req-1d150829-834d-4a4b-804c-f79c4bcfd840 req-18acef1c-53ef-4ab4-b6e8-7a357adce841 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:46:16Z,deleted=False,deleted_at=None,display_description='',display_name='9723cee9-030b-4569-90f9-15eb52c0d355-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2ed9936-b1c0-4ddf-bd6a-fc6713c3cb60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fc671775a304cc789bb9beb3b8ba47b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:46:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:46:17Z,use_quota=True,user_id='52bc9aff0b104aa19ab83685ea6380f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:46:36 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [req-1d150829-834d-4a4b-804c-f79c4bcfd840 req-18acef1c-53ef-4ab4-b6e8-7a357adce841 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Creating volume a2ed9936-b1c0-4ddf-bd6a-fc6713c3cb60 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:46:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [req-1d150829-834d-4a4b-804c-f79c4bcfd840 req-18acef1c-53ef-4ab4-b6e8-7a357adce841 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:46:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [req-1d150829-834d-4a4b-804c-f79c4bcfd840 req-18acef1c-53ef-4ab4-b6e8-7a357adce841 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:46:36 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [req-1d150829-834d-4a4b-804c-f79c4bcfd840 req-18acef1c-53ef-4ab4-b6e8-7a357adce841 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:46:36 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [req-1d150829-834d-4a4b-804c-f79c4bcfd840 req-18acef1c-53ef-4ab4-b6e8-7a357adce841 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:46:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [req-1d150829-834d-4a4b-804c-f79c4bcfd840 req-18acef1c-53ef-4ab4-b6e8-7a357adce841 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:46:36 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [req-1d150829-834d-4a4b-804c-f79c4bcfd840 req-18acef1c-53ef-4ab4-b6e8-7a357adce841 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:46:36 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [req-1d150829-834d-4a4b-804c-f79c4bcfd840 req-18acef1c-53ef-4ab4-b6e8-7a357adce841 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:46:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-1d150829-834d-4a4b-804c-f79c4bcfd840 req-18acef1c-53ef-4ab4-b6e8-7a357adce841 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a2ed9936-b1c0-4ddf-bd6a-fc6713c3cb60 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:36 devstack sudo[84321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a2ed9936-b1c0-4ddf-bd6a-fc6713c3cb60 1073741824 Apr 24 13:46:36 devstack sudo[84321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:36 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-0c0faca1-a453-40de-8ece-f341ada696e9 tempest-GroupsV314Test-191084596 None] Create group from source-group-35acf07c-d3a7-4aa9-9ef7-3c35b212549b completed successfully. Apr 24 13:46:37 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-1e52ad73-e98f-4d38-89c2-40359b19d993 tempest-GroupsV314Test-191084596 None] Acquiring lock "cinder-quobyte-010cb9ba-b6ce-4e36-a44c-77b5d4436357" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:46:37 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-1e52ad73-e98f-4d38-89c2-40359b19d993 tempest-GroupsV314Test-191084596 None] Lock "cinder-quobyte-010cb9ba-b6ce-4e36-a44c-77b5d4436357" acquired by "delete_volume" :: waited 0.019s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:46:37 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4430f09-474a-4141-8179-16b4328b5957]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:46:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-1e52ad73-e98f-4d38-89c2-40359b19d993 tempest-GroupsV314Test-191084596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-010cb9ba-b6ce-4e36-a44c-77b5d4436357 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:37 devstack sudo[84328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-010cb9ba-b6ce-4e36-a44c-77b5d4436357 Apr 24 13:46:37 devstack sudo[84328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:37 devstack sudo[84321]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-1d150829-834d-4a4b-804c-f79c4bcfd840 req-18acef1c-53ef-4ab4-b6e8-7a357adce841 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a2ed9936-b1c0-4ddf-bd6a-fc6713c3cb60 1073741824" returned: 0 in 0.786s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-1d150829-834d-4a4b-804c-f79c4bcfd840 req-18acef1c-53ef-4ab4-b6e8-7a357adce841 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a2ed9936-b1c0-4ddf-bd6a-fc6713c3cb60 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:37 devstack sudo[84330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a2ed9936-b1c0-4ddf-bd6a-fc6713c3cb60 Apr 24 13:46:37 devstack sudo[84330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:37 devstack cinder-volume[82046]: DEBUG oslo_service.periodic_task [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82046) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 13:46:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:46:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:46:37 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:46:37 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:46:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:46:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:37 devstack sudo[84335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:46:37 devstack sudo[84335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:38 devstack sudo[84328]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-1e52ad73-e98f-4d38-89c2-40359b19d993 tempest-GroupsV314Test-191084596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-010cb9ba-b6ce-4e36-a44c-77b5d4436357" returned: 0 in 0.887s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-1e52ad73-e98f-4d38-89c2-40359b19d993 tempest-GroupsV314Test-191084596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-010cb9ba-b6ce-4e36-a44c-77b5d4436357 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:38 devstack sudo[84344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-010cb9ba-b6ce-4e36-a44c-77b5d4436357 Apr 24 13:46:38 devstack sudo[84344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:38 devstack sudo[84330]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-1d150829-834d-4a4b-804c-f79c4bcfd840 req-18acef1c-53ef-4ab4-b6e8-7a357adce841 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a2ed9936-b1c0-4ddf-bd6a-fc6713c3cb60" returned: 0 in 0.675s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:38 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [req-1d150829-834d-4a4b-804c-f79c4bcfd840 req-18acef1c-53ef-4ab4-b6e8-7a357adce841 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] <== create_volume: return (1524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:46:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [req-1d150829-834d-4a4b-804c-f79c4bcfd840 req-18acef1c-53ef-4ab4-b6e8-7a357adce841 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.527s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:46:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-3bd62bd8-2362-46f4-b0a3-6c6c20c7490c tempest-GroupSnapshotsTest-1762123974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.662s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:46:38 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-3bd62bd8-2362-46f4-b0a3-6c6c20c7490c tempest-GroupSnapshotsTest-1762123974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6f72d1fb-74dd-478f-a19e-936867df8410,created_at=2026-04-24T11:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-161720533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6f72d1fb-74dd-478f-a19e-936867df8410,host='devstack@QuobyteHD#QuobyteHD',id=83e96f37-4d6a-48fa-8060-6fb3dace59d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4246a8fe8dcd4b2e9ca8333916bc2f43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:46:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:46:35Z,use_quota=True,user_id='d088ccb065cb430db99c689f055c7437',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e83f0bf9-1236-4965-9155-c423faca6a4b),volume_type_id=e83f0bf9-1236-4965-9155-c423faca6a4b)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:46:38 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-3bd62bd8-2362-46f4-b0a3-6c6c20c7490c tempest-GroupSnapshotsTest-1762123974 None] Creating volume 83e96f37-4d6a-48fa-8060-6fb3dace59d8 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:46:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-3bd62bd8-2362-46f4-b0a3-6c6c20c7490c tempest-GroupSnapshotsTest-1762123974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:46:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-3bd62bd8-2362-46f4-b0a3-6c6c20c7490c tempest-GroupSnapshotsTest-1762123974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:46:38 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-3bd62bd8-2362-46f4-b0a3-6c6c20c7490c tempest-GroupSnapshotsTest-1762123974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:46:38 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-3bd62bd8-2362-46f4-b0a3-6c6c20c7490c tempest-GroupSnapshotsTest-1762123974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:46:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-3bd62bd8-2362-46f4-b0a3-6c6c20c7490c tempest-GroupSnapshotsTest-1762123974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:46:38 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-3bd62bd8-2362-46f4-b0a3-6c6c20c7490c tempest-GroupSnapshotsTest-1762123974 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:46:38 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-3bd62bd8-2362-46f4-b0a3-6c6c20c7490c tempest-GroupSnapshotsTest-1762123974 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:46:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3bd62bd8-2362-46f4-b0a3-6c6c20c7490c tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:38 devstack sudo[84346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8 1073741824 Apr 24 13:46:38 devstack sudo[84346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:38 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-1d150829-834d-4a4b-804c-f79c4bcfd840 req-18acef1c-53ef-4ab4-b6e8-7a357adce841 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b5c35df-3e9e-4d1e-a02f-67526a5ac05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2ed9936-b1c0-4ddf-bd6a-fc6713c3cb60', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:46:38 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-1d150829-834d-4a4b-804c-f79c4bcfd840 req-18acef1c-53ef-4ab4-b6e8-7a357adce841 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78abdce4-09fb-4e7e-9cbc-19d57f3cbc4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:46:38 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [req-1d150829-834d-4a4b-804c-f79c4bcfd840 req-18acef1c-53ef-4ab4-b6e8-7a357adce841 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Volume volume-a2ed9936-b1c0-4ddf-bd6a-fc6713c3cb60 (a2ed9936-b1c0-4ddf-bd6a-fc6713c3cb60): created successfully Apr 24 13:46:38 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-1d150829-834d-4a4b-804c-f79c4bcfd840 req-18acef1c-53ef-4ab4-b6e8-7a357adce841 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78abdce4-09fb-4e7e-9cbc-19d57f3cbc4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:46:38 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-1d150829-834d-4a4b-804c-f79c4bcfd840 req-18acef1c-53ef-4ab4-b6e8-7a357adce841 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Flow 'volume_create_manager' (ccde575c-626d-4952-aa5a-1de28367e900) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:46:38 devstack cinder-volume[82046]: INFO cinder.volume.manager [req-1d150829-834d-4a4b-804c-f79c4bcfd840 req-18acef1c-53ef-4ab4-b6e8-7a357adce841 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Created volume successfully. Apr 24 13:46:38 devstack sudo[84335]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.763s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:38 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:46:39 devstack sudo[84344]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-1e52ad73-e98f-4d38-89c2-40359b19d993 tempest-GroupsV314Test-191084596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-010cb9ba-b6ce-4e36-a44c-77b5d4436357" returned: 0 in 0.678s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:39 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-1e52ad73-e98f-4d38-89c2-40359b19d993 tempest-GroupsV314Test-191084596 None] Lock "cinder-quobyte-010cb9ba-b6ce-4e36-a44c-77b5d4436357" released by "delete_volume" :: held 1.635s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:46:39 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-1e52ad73-e98f-4d38-89c2-40359b19d993 tempest-GroupsV314Test-191084596 None] Created reservations ['9bb81948-7642-4cf2-ab35-fb39b27e7547'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:46:39 devstack cinder-volume[82046]: WARNING cinder.quota [None req-1e52ad73-e98f-4d38-89c2-40359b19d993 tempest-GroupsV314Test-191084596 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-820613650 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-820613650, it is now deprecated. Please use the default quota class for default quota. Apr 24 13:46:39 devstack cinder-volume[82046]: WARNING cinder.quota [None req-1e52ad73-e98f-4d38-89c2-40359b19d993 tempest-GroupsV314Test-191084596 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-820613650 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-820613650, it is now deprecated. Please use the default quota class for default quota. Apr 24 13:46:39 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-1e52ad73-e98f-4d38-89c2-40359b19d993 tempest-GroupsV314Test-191084596 None] Created reservations ['e22b32d9-f25b-4039-9b21-e8a2edf77ff9', 'ae742f84-4a24-4d61-ace6-286890040e86', 'ea89c845-0ada-4c73-b070-845ec29380b2', '0f8bbc6e-7d89-4cad-901f-0b93fd83b9d9'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:46:39 devstack sudo[84346]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3bd62bd8-2362-46f4-b0a3-6c6c20c7490c tempest-GroupSnapshotsTest-1762123974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8 1073741824" returned: 0 in 0.874s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3bd62bd8-2362-46f4-b0a3-6c6c20c7490c tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:39 devstack sudo[84376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8 Apr 24 13:46:39 devstack sudo[84376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-1e52ad73-e98f-4d38-89c2-40359b19d993 tempest-GroupsV314Test-191084596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:46:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-1e52ad73-e98f-4d38-89c2-40359b19d993 tempest-GroupsV314Test-191084596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:46:39 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-1e52ad73-e98f-4d38-89c2-40359b19d993 tempest-GroupsV314Test-191084596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:46:39 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-1e52ad73-e98f-4d38-89c2-40359b19d993 tempest-GroupsV314Test-191084596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:46:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-1e52ad73-e98f-4d38-89c2-40359b19d993 tempest-GroupsV314Test-191084596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:46:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-1e52ad73-e98f-4d38-89c2-40359b19d993 tempest-GroupsV314Test-191084596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:39 devstack sudo[84382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:46:39 devstack sudo[84382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:40 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [req-1d150829-834d-4a4b-804c-f79c4bcfd840 req-d2b3a111-7a8c-4152-8082-41be059620f3 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:46:40 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-6d774597-d813-40da-a2da-e241016b87ea tempest-GroupsV314Test-191084596 None] Acquiring lock "cinder-quobyte-860e4488-5acc-45e1-9a1d-2f553ce53dad" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:46:40 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-6d774597-d813-40da-a2da-e241016b87ea tempest-GroupsV314Test-191084596 None] Lock "cinder-quobyte-860e4488-5acc-45e1-9a1d-2f553ce53dad" acquired by "delete_volume" :: waited 0.061s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:46:40 devstack sudo[84382]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:40 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6614b35-055a-460d-9ffc-a4fcd82349a6]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:46:40 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6d774597-d813-40da-a2da-e241016b87ea tempest-GroupsV314Test-191084596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:40 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-1e52ad73-e98f-4d38-89c2-40359b19d993 tempest-GroupsV314Test-191084596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.967s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:40 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-1e52ad73-e98f-4d38-89c2-40359b19d993 tempest-GroupsV314Test-191084596 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:46:40 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-1e52ad73-e98f-4d38-89c2-40359b19d993 tempest-GroupsV314Test-191084596 None] Delete group completed successfully. Apr 24 13:46:40 devstack sudo[84376]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:40 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3bd62bd8-2362-46f4-b0a3-6c6c20c7490c tempest-GroupSnapshotsTest-1762123974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8" returned: 0 in 1.204s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:40 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-3bd62bd8-2362-46f4-b0a3-6c6c20c7490c tempest-GroupSnapshotsTest-1762123974 None] <== create_volume: return (2322ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:46:40 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-3bd62bd8-2362-46f4-b0a3-6c6c20c7490c tempest-GroupSnapshotsTest-1762123974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.325s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:46:40 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [req-1d150829-834d-4a4b-804c-f79c4bcfd840 req-d2b3a111-7a8c-4152-8082-41be059620f3 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.663s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:46:40 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-3bd62bd8-2362-46f4-b0a3-6c6c20c7490c tempest-GroupSnapshotsTest-1762123974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f8072ee-28ce-4184-ba6a-59b3c9d0f77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:46:40 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-3bd62bd8-2362-46f4-b0a3-6c6c20c7490c tempest-GroupSnapshotsTest-1762123974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (699caf2e-c349-4e5f-bfb0-556a5839d301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:46:40 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e68c3d1-caa8-4715-a9b4-cdc788d3c303]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:46:40 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-1d150829-834d-4a4b-804c-f79c4bcfd840 req-d2b3a111-7a8c-4152-8082-41be059620f3 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a2ed9936-b1c0-4ddf-bd6a-fc6713c3cb60 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:40 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-3bd62bd8-2362-46f4-b0a3-6c6c20c7490c tempest-GroupSnapshotsTest-1762123974 None] Volume volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8 (83e96f37-4d6a-48fa-8060-6fb3dace59d8): created successfully Apr 24 13:46:40 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-3bd62bd8-2362-46f4-b0a3-6c6c20c7490c tempest-GroupSnapshotsTest-1762123974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (699caf2e-c349-4e5f-bfb0-556a5839d301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:46:40 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-3bd62bd8-2362-46f4-b0a3-6c6c20c7490c tempest-GroupSnapshotsTest-1762123974 None] Flow 'volume_create_manager' (7a7b2a12-5289-4b9b-a5ba-d9218c06f043) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:46:40 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-3bd62bd8-2362-46f4-b0a3-6c6c20c7490c tempest-GroupSnapshotsTest-1762123974 None] Created volume successfully. Apr 24 13:46:40 devstack sudo[84407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad Apr 24 13:46:40 devstack sudo[84407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:40 devstack sudo[84409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a2ed9936-b1c0-4ddf-bd6a-fc6713c3cb60 Apr 24 13:46:40 devstack sudo[84409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:41 devstack sudo[84407]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6d774597-d813-40da-a2da-e241016b87ea tempest-GroupsV314Test-191084596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad" returned: 0 in 0.898s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6d774597-d813-40da-a2da-e241016b87ea tempest-GroupsV314Test-191084596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:41 devstack sudo[84420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad Apr 24 13:46:41 devstack sudo[84420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:41 devstack sudo[84409]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-1d150829-834d-4a4b-804c-f79c4bcfd840 req-d2b3a111-7a8c-4152-8082-41be059620f3 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a2ed9936-b1c0-4ddf-bd6a-fc6713c3cb60" returned: 0 in 0.864s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [req-1d150829-834d-4a4b-804c-f79c4bcfd840 req-d2b3a111-7a8c-4152-8082-41be059620f3 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.913s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:46:41 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-1d150829-834d-4a4b-804c-f79c4bcfd840 req-d2b3a111-7a8c-4152-8082-41be059620f3 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23', 'name': 'volume-a2ed9936-b1c0-4ddf-bd6a-fc6713c3cb60', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bf574621-131f-4a47-b613-15df4f703c6a', 'enforce_multipath': True} {{(pid=82046) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 24 13:46:41 devstack cinder-volume[82046]: INFO cinder.volume.manager [req-1d150829-834d-4a4b-804c-f79c4bcfd840 req-d2b3a111-7a8c-4152-8082-41be059620f3 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] attachment_update completed successfully. Apr 24 13:46:42 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-4bc294ad-4e31-4adf-ad41-8a5c45cd1361 tempest-GroupSnapshotsTest-1762123974 None] GroupSnapshot 28dca03b-756c-4026-a78a-e601fb4560c5: creating. Apr 24 13:46:42 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4bc294ad-4e31-4adf-ad41-8a5c45cd1361 tempest-GroupSnapshotsTest-1762123974 None] Group snapshot 28dca03b-756c-4026-a78a-e601fb4560c5: creating. {{(pid=82046) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 24 13:46:42 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4bc294ad-4e31-4adf-ad41-8a5c45cd1361 tempest-GroupSnapshotsTest-1762123974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:46:42 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4bc294ad-4e31-4adf-ad41-8a5c45cd1361 tempest-GroupSnapshotsTest-1762123974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:46:42 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-4bc294ad-4e31-4adf-ad41-8a5c45cd1361 tempest-GroupSnapshotsTest-1762123974 None] Creating offline snapshot cc53ae99-e223-484e-b285-e0e2fe58fe71 of volume 83e96f37-4d6a-48fa-8060-6fb3dace59d8 {{(pid=82046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 13:46:42 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[5082b0b2-7cb7-47f3-b27b-65e8046f3330]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:46:42 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4bc294ad-4e31-4adf-ad41-8a5c45cd1361 tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:42 devstack sudo[84420]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:42 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6d774597-d813-40da-a2da-e241016b87ea tempest-GroupsV314Test-191084596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-860e4488-5acc-45e1-9a1d-2f553ce53dad" returned: 0 in 1.191s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:42 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-6d774597-d813-40da-a2da-e241016b87ea tempest-GroupsV314Test-191084596 None] Lock "cinder-quobyte-860e4488-5acc-45e1-9a1d-2f553ce53dad" released by "delete_volume" :: held 2.241s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:46:42 devstack sudo[84441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8 Apr 24 13:46:42 devstack sudo[84441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:42 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-6d774597-d813-40da-a2da-e241016b87ea tempest-GroupsV314Test-191084596 None] Created reservations ['9fe4710a-43ce-4c4e-916f-b46aead15b8d'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:46:43 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-6d774597-d813-40da-a2da-e241016b87ea tempest-GroupsV314Test-191084596 None] Created reservations ['e572d3a3-5d99-4373-8a76-95ae9fae7515', '585bbc92-ad67-45d3-80a2-e684383f9191', '80fabb2d-57c1-43d2-ac94-a074828839d3', '6e42db52-08a1-4edf-b08a-a9edffef0c19'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:46:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-6d774597-d813-40da-a2da-e241016b87ea tempest-GroupsV314Test-191084596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:46:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-6d774597-d813-40da-a2da-e241016b87ea tempest-GroupsV314Test-191084596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:46:43 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-6d774597-d813-40da-a2da-e241016b87ea tempest-GroupsV314Test-191084596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:46:43 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-6d774597-d813-40da-a2da-e241016b87ea tempest-GroupsV314Test-191084596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:46:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-6d774597-d813-40da-a2da-e241016b87ea tempest-GroupsV314Test-191084596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:46:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6d774597-d813-40da-a2da-e241016b87ea tempest-GroupsV314Test-191084596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:43 devstack sudo[84445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:46:43 devstack sudo[84445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:43 devstack sudo[84441]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4bc294ad-4e31-4adf-ad41-8a5c45cd1361 tempest-GroupSnapshotsTest-1762123974 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8" returned: 0 in 1.160s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4bc294ad-4e31-4adf-ad41-8a5c45cd1361 tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8.cc53ae99-e223-484e-b285-e0e2fe58fe71 1G {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:43 devstack sudo[84451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8.cc53ae99-e223-484e-b285-e0e2fe58fe71 1G Apr 24 13:46:43 devstack sudo[84451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:44 devstack sudo[84445]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6d774597-d813-40da-a2da-e241016b87ea tempest-GroupsV314Test-191084596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.713s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:44 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-6d774597-d813-40da-a2da-e241016b87ea tempest-GroupsV314Test-191084596 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:46:44 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-6d774597-d813-40da-a2da-e241016b87ea tempest-GroupsV314Test-191084596 None] Delete group completed successfully. Apr 24 13:46:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4bc294ad-4e31-4adf-ad41-8a5c45cd1361 tempest-GroupSnapshotsTest-1762123974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8.cc53ae99-e223-484e-b285-e0e2fe58fe71 1G" returned: 0 in 1.222s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4bc294ad-4e31-4adf-ad41-8a5c45cd1361 tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8.cc53ae99-e223-484e-b285-e0e2fe58fe71 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:45 devstack sudo[84451]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:45 devstack sudo[84547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8.cc53ae99-e223-484e-b285-e0e2fe58fe71 Apr 24 13:46:45 devstack sudo[84547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:45 devstack sudo[84547]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4bc294ad-4e31-4adf-ad41-8a5c45cd1361 tempest-GroupSnapshotsTest-1762123974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8.cc53ae99-e223-484e-b285-e0e2fe58fe71" returned: 0 in 0.794s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:45 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-4bc294ad-4e31-4adf-ad41-8a5c45cd1361 tempest-GroupSnapshotsTest-1762123974 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8.cc53ae99-e223-484e-b285-e0e2fe58fe71 is being set with open permissions: ugo+rw: NotImplementedError Apr 24 13:46:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4bc294ad-4e31-4adf-ad41-8a5c45cd1361 tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8.cc53ae99-e223-484e-b285-e0e2fe58fe71 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:45 devstack sudo[84567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8.cc53ae99-e223-484e-b285-e0e2fe58fe71 Apr 24 13:46:45 devstack sudo[84567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:46 devstack sudo[84567]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:46 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4bc294ad-4e31-4adf-ad41-8a5c45cd1361 tempest-GroupSnapshotsTest-1762123974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8.cc53ae99-e223-484e-b285-e0e2fe58fe71" returned: 0 in 0.647s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:46 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4bc294ad-4e31-4adf-ad41-8a5c45cd1361 tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:46 devstack sudo[84571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8.info Apr 24 13:46:46 devstack sudo[84571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:47 devstack sudo[84571]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4bc294ad-4e31-4adf-ad41-8a5c45cd1361 tempest-GroupSnapshotsTest-1762123974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8.info" returned: 0 in 0.664s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:47 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-4bc294ad-4e31-4adf-ad41-8a5c45cd1361 tempest-GroupSnapshotsTest-1762123974 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8.info is being set with open permissions: ugo+rw: NotImplementedError Apr 24 13:46:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4bc294ad-4e31-4adf-ad41-8a5c45cd1361 tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:47 devstack sudo[84892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8.info Apr 24 13:46:47 devstack sudo[84892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:47 devstack sudo[84892]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4bc294ad-4e31-4adf-ad41-8a5c45cd1361 tempest-GroupSnapshotsTest-1762123974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8.info" returned: 0 in 0.494s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4bc294ad-4e31-4adf-ad41-8a5c45cd1361 tempest-GroupSnapshotsTest-1762123974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.131s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:46:47 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-4bc294ad-4e31-4adf-ad41-8a5c45cd1361 tempest-GroupSnapshotsTest-1762123974 None] group_snapshot 28dca03b-756c-4026-a78a-e601fb4560c5: created successfully Apr 24 13:46:48 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-8b3d9189-90bf-44e9-b380-abd23bef181e tempest-GroupSnapshotsTest-1762123974 None] group_snapshot 28dca03b-756c-4026-a78a-e601fb4560c5: deleting Apr 24 13:46:48 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8b3d9189-90bf-44e9-b380-abd23bef181e tempest-GroupSnapshotsTest-1762123974 None] group_snapshot 28dca03b-756c-4026-a78a-e601fb4560c5: deleting {{(pid=82046) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 24 13:46:48 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-8b3d9189-90bf-44e9-b380-abd23bef181e tempest-GroupSnapshotsTest-1762123974 None] Acquiring lock "cinder-quobyte-83e96f37-4d6a-48fa-8060-6fb3dace59d8" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:46:48 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-8b3d9189-90bf-44e9-b380-abd23bef181e tempest-GroupSnapshotsTest-1762123974 None] Lock "cinder-quobyte-83e96f37-4d6a-48fa-8060-6fb3dace59d8" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:46:48 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-8b3d9189-90bf-44e9-b380-abd23bef181e tempest-GroupSnapshotsTest-1762123974 None] Acquiring lock "cinder-quobyte-cc53ae99-e223-484e-b285-e0e2fe58fe71" by "_delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:46:48 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-8b3d9189-90bf-44e9-b380-abd23bef181e tempest-GroupSnapshotsTest-1762123974 None] Lock "cinder-quobyte-cc53ae99-e223-484e-b285-e0e2fe58fe71" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:46:48 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-8b3d9189-90bf-44e9-b380-abd23bef181e tempest-GroupSnapshotsTest-1762123974 None] Deleting offline snapshot cc53ae99-e223-484e-b285-e0e2fe58fe71 of volume 83e96f37-4d6a-48fa-8060-6fb3dace59d8 {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 13:46:48 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-8b3d9189-90bf-44e9-b380-abd23bef181e tempest-GroupSnapshotsTest-1762123974 None] snapshot_file for this snap is: volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8.cc53ae99-e223-484e-b285-e0e2fe58fe71 {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 13:46:48 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af818ee-5c01-49c5-ba1f-e006b2176f76]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:46:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8b3d9189-90bf-44e9-b380-abd23bef181e tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8.cc53ae99-e223-484e-b285-e0e2fe58fe71 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:48 devstack sudo[84906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8.cc53ae99-e223-484e-b285-e0e2fe58fe71 Apr 24 13:46:48 devstack sudo[84906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:49 devstack sudo[84906]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8b3d9189-90bf-44e9-b380-abd23bef181e tempest-GroupSnapshotsTest-1762123974 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8.cc53ae99-e223-484e-b285-e0e2fe58fe71" returned: 0 in 0.999s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:49 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-8b3d9189-90bf-44e9-b380-abd23bef181e tempest-GroupSnapshotsTest-1762123974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:46:49 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bcf579-f069-4bd0-b0ee-a919533b2d1c]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:46:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8b3d9189-90bf-44e9-b380-abd23bef181e tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:49 devstack sudo[84941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8 Apr 24 13:46:49 devstack sudo[84941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:50 devstack sudo[84941]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8b3d9189-90bf-44e9-b380-abd23bef181e tempest-GroupSnapshotsTest-1762123974 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8" returned: 0 in 0.881s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8b3d9189-90bf-44e9-b380-abd23bef181e tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8.cc53ae99-e223-484e-b285-e0e2fe58fe71 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:50 devstack sudo[84954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8.cc53ae99-e223-484e-b285-e0e2fe58fe71 Apr 24 13:46:50 devstack sudo[84954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:50 devstack sudo[84954]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8b3d9189-90bf-44e9-b380-abd23bef181e tempest-GroupSnapshotsTest-1762123974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8.cc53ae99-e223-484e-b285-e0e2fe58fe71" returned: 0 in 0.680s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8b3d9189-90bf-44e9-b380-abd23bef181e tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8.cc53ae99-e223-484e-b285-e0e2fe58fe71 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:50 devstack sudo[84959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8.cc53ae99-e223-484e-b285-e0e2fe58fe71 Apr 24 13:46:50 devstack sudo[84959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:51 devstack sudo[84959]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8b3d9189-90bf-44e9-b380-abd23bef181e tempest-GroupSnapshotsTest-1762123974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8.cc53ae99-e223-484e-b285-e0e2fe58fe71" returned: 0 in 0.660s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:51 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-8b3d9189-90bf-44e9-b380-abd23bef181e tempest-GroupSnapshotsTest-1762123974 None] Lock "cinder-quobyte-cc53ae99-e223-484e-b285-e0e2fe58fe71" released by "_delete_snapshot" :: held 3.363s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:46:51 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-8b3d9189-90bf-44e9-b380-abd23bef181e tempest-GroupSnapshotsTest-1762123974 None] Lock "cinder-quobyte-83e96f37-4d6a-48fa-8060-6fb3dace59d8" released by "delete_snapshot" :: held 3.396s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:46:51 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-d492c89a-2ee1-458f-841a-dc590dcd1c24 tempest-ServersNegativeTestJSON-1126403732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:46:51 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d492c89a-2ee1-458f-841a-dc590dcd1c24 tempest-ServersNegativeTestJSON-1126403732 None] Flow 'volume_create_manager' (70631e8c-14b4-4695-b95f-ae28a735ea04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:46:51 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d492c89a-2ee1-458f-841a-dc590dcd1c24 tempest-ServersNegativeTestJSON-1126403732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a391384-78ac-463f-a623-edd4090df07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:46:51 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d492c89a-2ee1-458f-841a-dc590dcd1c24 tempest-ServersNegativeTestJSON-1126403732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a391384-78ac-463f-a623-edd4090df07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:46:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-186470385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=197189db-32f3-4276-8294-307de48ddb43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f734f417efd474499ab6de754bb4120',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:46:52Z,use_quota=True,user_id='0c519146bbe848788a08663621eef607',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:46:51 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d492c89a-2ee1-458f-841a-dc590dcd1c24 tempest-ServersNegativeTestJSON-1126403732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f9f378b-ced5-45e5-a555-3d3882ed3cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:46:51 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d492c89a-2ee1-458f-841a-dc590dcd1c24 tempest-ServersNegativeTestJSON-1126403732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f9f378b-ced5-45e5-a555-3d3882ed3cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:46:51 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d492c89a-2ee1-458f-841a-dc590dcd1c24 tempest-ServersNegativeTestJSON-1126403732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db016473-f1d1-46d9-9193-6453f9042bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:46:51 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d492c89a-2ee1-458f-841a-dc590dcd1c24 tempest-ServersNegativeTestJSON-1126403732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db016473-f1d1-46d9-9193-6453f9042bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '197189db-32f3-4276-8294-307de48ddb43', 'volume_name': 'volume-197189db-32f3-4276-8294-307de48ddb43', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:46:51 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d492c89a-2ee1-458f-841a-dc590dcd1c24 tempest-ServersNegativeTestJSON-1126403732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e25a9abd-3809-42c6-a8c8-3cbed6380451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:46:51 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d492c89a-2ee1-458f-841a-dc590dcd1c24 tempest-ServersNegativeTestJSON-1126403732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e25a9abd-3809-42c6-a8c8-3cbed6380451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:46:51 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d492c89a-2ee1-458f-841a-dc590dcd1c24 tempest-ServersNegativeTestJSON-1126403732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c935852b-08af-407a-bb7d-8015f6374af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:46:51 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-d492c89a-2ee1-458f-841a-dc590dcd1c24 tempest-ServersNegativeTestJSON-1126403732 None] Volume 197189db-32f3-4276-8294-307de48ddb43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-197189db-32f3-4276-8294-307de48ddb43', 'volume_size': 1} Apr 24 13:46:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d492c89a-2ee1-458f-841a-dc590dcd1c24 tempest-ServersNegativeTestJSON-1126403732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:46:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d492c89a-2ee1-458f-841a-dc590dcd1c24 tempest-ServersNegativeTestJSON-1126403732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:46:51 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-d492c89a-2ee1-458f-841a-dc590dcd1c24 tempest-ServersNegativeTestJSON-1126403732 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:46:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-186470385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=197189db-32f3-4276-8294-307de48ddb43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f734f417efd474499ab6de754bb4120',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:46:52Z,use_quota=True,user_id='0c519146bbe848788a08663621eef607',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:46:51 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-d492c89a-2ee1-458f-841a-dc590dcd1c24 tempest-ServersNegativeTestJSON-1126403732 None] Creating volume 197189db-32f3-4276-8294-307de48ddb43 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:46:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d492c89a-2ee1-458f-841a-dc590dcd1c24 tempest-ServersNegativeTestJSON-1126403732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:46:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d492c89a-2ee1-458f-841a-dc590dcd1c24 tempest-ServersNegativeTestJSON-1126403732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:46:51 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-d492c89a-2ee1-458f-841a-dc590dcd1c24 tempest-ServersNegativeTestJSON-1126403732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:46:51 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-d492c89a-2ee1-458f-841a-dc590dcd1c24 tempest-ServersNegativeTestJSON-1126403732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:46:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d492c89a-2ee1-458f-841a-dc590dcd1c24 tempest-ServersNegativeTestJSON-1126403732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:46:51 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-d492c89a-2ee1-458f-841a-dc590dcd1c24 tempest-ServersNegativeTestJSON-1126403732 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:46:51 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-d492c89a-2ee1-458f-841a-dc590dcd1c24 tempest-ServersNegativeTestJSON-1126403732 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:46:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d492c89a-2ee1-458f-841a-dc590dcd1c24 tempest-ServersNegativeTestJSON-1126403732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-197189db-32f3-4276-8294-307de48ddb43 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:51 devstack sudo[84963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-197189db-32f3-4276-8294-307de48ddb43 1073741824 Apr 24 13:46:51 devstack sudo[84963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:51 devstack cinder-volume[82046]: WARNING cinder.quota [None req-8b3d9189-90bf-44e9-b380-abd23bef181e tempest-GroupSnapshotsTest-1762123974 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-52777214 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-52777214, it is now deprecated. Please use the default quota class for default quota. Apr 24 13:46:51 devstack cinder-volume[82046]: WARNING cinder.quota [None req-8b3d9189-90bf-44e9-b380-abd23bef181e tempest-GroupSnapshotsTest-1762123974 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-52777214 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-52777214, it is now deprecated. Please use the default quota class for default quota. Apr 24 13:46:51 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-8b3d9189-90bf-44e9-b380-abd23bef181e tempest-GroupSnapshotsTest-1762123974 None] Created reservations ['6119b07c-25a7-4165-8a11-2f71ad34db34', '7f052101-f119-4895-9db6-5a19fe0e6c40', '81222a87-5b9c-46a9-9363-ce42c601d3d8', 'e01383d7-e165-4fe6-8949-db499f83af37'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:46:51 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-8b3d9189-90bf-44e9-b380-abd23bef181e tempest-GroupSnapshotsTest-1762123974 None] group_snapshot 28dca03b-756c-4026-a78a-e601fb4560c5: deleted successfully Apr 24 13:46:52 devstack sudo[84963]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:52 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d492c89a-2ee1-458f-841a-dc590dcd1c24 tempest-ServersNegativeTestJSON-1126403732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-197189db-32f3-4276-8294-307de48ddb43 1073741824" returned: 0 in 0.690s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:52 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d492c89a-2ee1-458f-841a-dc590dcd1c24 tempest-ServersNegativeTestJSON-1126403732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-197189db-32f3-4276-8294-307de48ddb43 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:52 devstack sudo[84968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-197189db-32f3-4276-8294-307de48ddb43 Apr 24 13:46:52 devstack sudo[84968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:52 devstack sudo[84968]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d492c89a-2ee1-458f-841a-dc590dcd1c24 tempest-ServersNegativeTestJSON-1126403732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-197189db-32f3-4276-8294-307de48ddb43" returned: 0 in 0.535s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:53 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-d492c89a-2ee1-458f-841a-dc590dcd1c24 tempest-ServersNegativeTestJSON-1126403732 None] <== create_volume: return (1267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:46:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d492c89a-2ee1-458f-841a-dc590dcd1c24 tempest-ServersNegativeTestJSON-1126403732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.269s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:46:53 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d492c89a-2ee1-458f-841a-dc590dcd1c24 tempest-ServersNegativeTestJSON-1126403732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c935852b-08af-407a-bb7d-8015f6374af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-197189db-32f3-4276-8294-307de48ddb43', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:46:53 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d492c89a-2ee1-458f-841a-dc590dcd1c24 tempest-ServersNegativeTestJSON-1126403732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eb22b29-2467-41ca-82c4-c6e2bb5772a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:46:53 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-032696db-1cd5-47b8-9e11-f44ecb358901 tempest-GroupSnapshotsTest-1762123974 None] Acquiring lock "cinder-quobyte-83e96f37-4d6a-48fa-8060-6fb3dace59d8" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:46:53 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-d492c89a-2ee1-458f-841a-dc590dcd1c24 tempest-ServersNegativeTestJSON-1126403732 None] Volume volume-197189db-32f3-4276-8294-307de48ddb43 (197189db-32f3-4276-8294-307de48ddb43): created successfully Apr 24 13:46:53 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d492c89a-2ee1-458f-841a-dc590dcd1c24 tempest-ServersNegativeTestJSON-1126403732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eb22b29-2467-41ca-82c4-c6e2bb5772a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:46:53 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d492c89a-2ee1-458f-841a-dc590dcd1c24 tempest-ServersNegativeTestJSON-1126403732 None] Flow 'volume_create_manager' (70631e8c-14b4-4695-b95f-ae28a735ea04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:46:53 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-d492c89a-2ee1-458f-841a-dc590dcd1c24 tempest-ServersNegativeTestJSON-1126403732 None] Created volume successfully. Apr 24 13:46:53 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-032696db-1cd5-47b8-9e11-f44ecb358901 tempest-GroupSnapshotsTest-1762123974 None] Lock "cinder-quobyte-83e96f37-4d6a-48fa-8060-6fb3dace59d8" acquired by "delete_volume" :: waited 0.060s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:46:53 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[312629d3-9d92-4bce-ada9-55f6b604eb19]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:46:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-032696db-1cd5-47b8-9e11-f44ecb358901 tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:53 devstack sudo[84971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8 Apr 24 13:46:53 devstack sudo[84971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:53 devstack sudo[84971]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-032696db-1cd5-47b8-9e11-f44ecb358901 tempest-GroupSnapshotsTest-1762123974 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8" returned: 0 in 0.751s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-032696db-1cd5-47b8-9e11-f44ecb358901 tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:53 devstack sudo[84976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8 Apr 24 13:46:53 devstack sudo[84976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:54 devstack sudo[84976]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:54 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-032696db-1cd5-47b8-9e11-f44ecb358901 tempest-GroupSnapshotsTest-1762123974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-83e96f37-4d6a-48fa-8060-6fb3dace59d8" returned: 0 in 0.720s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:54 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-032696db-1cd5-47b8-9e11-f44ecb358901 tempest-GroupSnapshotsTest-1762123974 None] Lock "cinder-quobyte-83e96f37-4d6a-48fa-8060-6fb3dace59d8" released by "delete_volume" :: held 1.550s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:46:54 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-032696db-1cd5-47b8-9e11-f44ecb358901 tempest-GroupSnapshotsTest-1762123974 None] Created reservations ['bb60f8ea-646f-4869-8c04-f3a6d0da4916'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:46:54 devstack cinder-volume[82046]: WARNING cinder.quota [None req-032696db-1cd5-47b8-9e11-f44ecb358901 tempest-GroupSnapshotsTest-1762123974 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-52777214 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-52777214, it is now deprecated. Please use the default quota class for default quota. Apr 24 13:46:54 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-032696db-1cd5-47b8-9e11-f44ecb358901 tempest-GroupSnapshotsTest-1762123974 None] Created reservations ['beaf4a5d-76f9-41ad-bab4-9ce5df682e6c', '222e8420-5441-4595-b5c4-6f4bf3092082', '8e4bffa1-d952-4f84-87a0-4f0e2df8090d', '44bd5c1c-77d1-4757-bf76-6e8bed7218b5'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:46:54 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-032696db-1cd5-47b8-9e11-f44ecb358901 tempest-GroupSnapshotsTest-1762123974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:46:54 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-032696db-1cd5-47b8-9e11-f44ecb358901 tempest-GroupSnapshotsTest-1762123974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:46:54 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-032696db-1cd5-47b8-9e11-f44ecb358901 tempest-GroupSnapshotsTest-1762123974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:46:55 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-032696db-1cd5-47b8-9e11-f44ecb358901 tempest-GroupSnapshotsTest-1762123974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:46:55 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-032696db-1cd5-47b8-9e11-f44ecb358901 tempest-GroupSnapshotsTest-1762123974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:46:55 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-032696db-1cd5-47b8-9e11-f44ecb358901 tempest-GroupSnapshotsTest-1762123974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:55 devstack sudo[84981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:46:55 devstack sudo[84981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:55 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-62549566-7f10-4eb4-9c61-5599af55c882 tempest-ServersNegativeTestJSON-1126403732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:46:55 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-62549566-7f10-4eb4-9c61-5599af55c882 tempest-ServersNegativeTestJSON-1126403732 None] Flow 'volume_create_manager' (06fb29c4-fcae-49bd-95eb-7a8c3944bd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:46:55 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-62549566-7f10-4eb4-9c61-5599af55c882 tempest-ServersNegativeTestJSON-1126403732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f07681e-3926-4fa8-98bf-d5cfc29bb5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:46:55 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-62549566-7f10-4eb4-9c61-5599af55c882 tempest-ServersNegativeTestJSON-1126403732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f07681e-3926-4fa8-98bf-d5cfc29bb5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:46:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-106339689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d41bcdef-1daf-4fd0-a828-cae4f6bb5e9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f734f417efd474499ab6de754bb4120',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:46:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:46:55Z,use_quota=True,user_id='0c519146bbe848788a08663621eef607',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:46:55 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-62549566-7f10-4eb4-9c61-5599af55c882 tempest-ServersNegativeTestJSON-1126403732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8f11e68-874a-408a-aff6-40de0784f78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:46:55 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-62549566-7f10-4eb4-9c61-5599af55c882 tempest-ServersNegativeTestJSON-1126403732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8f11e68-874a-408a-aff6-40de0784f78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:46:55 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-62549566-7f10-4eb4-9c61-5599af55c882 tempest-ServersNegativeTestJSON-1126403732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60bd2974-8218-48c5-8ef9-4d3b2321fd2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:46:55 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-62549566-7f10-4eb4-9c61-5599af55c882 tempest-ServersNegativeTestJSON-1126403732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60bd2974-8218-48c5-8ef9-4d3b2321fd2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd41bcdef-1daf-4fd0-a828-cae4f6bb5e9b', 'volume_name': 'volume-d41bcdef-1daf-4fd0-a828-cae4f6bb5e9b', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:46:55 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-62549566-7f10-4eb4-9c61-5599af55c882 tempest-ServersNegativeTestJSON-1126403732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1b7bab1-9969-4749-bb29-05a3b681e8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:46:55 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-62549566-7f10-4eb4-9c61-5599af55c882 tempest-ServersNegativeTestJSON-1126403732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1b7bab1-9969-4749-bb29-05a3b681e8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:46:55 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-62549566-7f10-4eb4-9c61-5599af55c882 tempest-ServersNegativeTestJSON-1126403732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac7c909a-9e69-474b-8be0-c3d1e1ca65d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:46:55 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-62549566-7f10-4eb4-9c61-5599af55c882 tempest-ServersNegativeTestJSON-1126403732 None] Volume d41bcdef-1daf-4fd0-a828-cae4f6bb5e9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d41bcdef-1daf-4fd0-a828-cae4f6bb5e9b', 'volume_size': 1} Apr 24 13:46:55 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-62549566-7f10-4eb4-9c61-5599af55c882 tempest-ServersNegativeTestJSON-1126403732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:46:55 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-62549566-7f10-4eb4-9c61-5599af55c882 tempest-ServersNegativeTestJSON-1126403732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:46:55 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-62549566-7f10-4eb4-9c61-5599af55c882 tempest-ServersNegativeTestJSON-1126403732 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:46:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-106339689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d41bcdef-1daf-4fd0-a828-cae4f6bb5e9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f734f417efd474499ab6de754bb4120',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:46:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:46:55Z,use_quota=True,user_id='0c519146bbe848788a08663621eef607',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:46:55 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-62549566-7f10-4eb4-9c61-5599af55c882 tempest-ServersNegativeTestJSON-1126403732 None] Creating volume d41bcdef-1daf-4fd0-a828-cae4f6bb5e9b {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:46:55 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-62549566-7f10-4eb4-9c61-5599af55c882 tempest-ServersNegativeTestJSON-1126403732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:46:55 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-62549566-7f10-4eb4-9c61-5599af55c882 tempest-ServersNegativeTestJSON-1126403732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:46:55 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-62549566-7f10-4eb4-9c61-5599af55c882 tempest-ServersNegativeTestJSON-1126403732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:46:55 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-62549566-7f10-4eb4-9c61-5599af55c882 tempest-ServersNegativeTestJSON-1126403732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:46:55 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-62549566-7f10-4eb4-9c61-5599af55c882 tempest-ServersNegativeTestJSON-1126403732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:46:55 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-62549566-7f10-4eb4-9c61-5599af55c882 tempest-ServersNegativeTestJSON-1126403732 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:46:55 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-62549566-7f10-4eb4-9c61-5599af55c882 tempest-ServersNegativeTestJSON-1126403732 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:46:55 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-62549566-7f10-4eb4-9c61-5599af55c882 tempest-ServersNegativeTestJSON-1126403732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d41bcdef-1daf-4fd0-a828-cae4f6bb5e9b 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:55 devstack sudo[84984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d41bcdef-1daf-4fd0-a828-cae4f6bb5e9b 1073741824 Apr 24 13:46:55 devstack sudo[84984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:55 devstack sudo[84981]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:55 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-032696db-1cd5-47b8-9e11-f44ecb358901 tempest-GroupSnapshotsTest-1762123974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.960s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:55 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-032696db-1cd5-47b8-9e11-f44ecb358901 tempest-GroupSnapshotsTest-1762123974 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:46:55 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-032696db-1cd5-47b8-9e11-f44ecb358901 tempest-GroupSnapshotsTest-1762123974 None] Delete group completed successfully. Apr 24 13:46:56 devstack sudo[84984]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:56 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-62549566-7f10-4eb4-9c61-5599af55c882 tempest-ServersNegativeTestJSON-1126403732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d41bcdef-1daf-4fd0-a828-cae4f6bb5e9b 1073741824" returned: 0 in 1.226s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:56 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-62549566-7f10-4eb4-9c61-5599af55c882 tempest-ServersNegativeTestJSON-1126403732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d41bcdef-1daf-4fd0-a828-cae4f6bb5e9b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:46:56 devstack sudo[84990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d41bcdef-1daf-4fd0-a828-cae4f6bb5e9b Apr 24 13:46:56 devstack sudo[84990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:46:57 devstack sudo[84990]: pam_unix(sudo:session): session closed for user root Apr 24 13:46:57 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-62549566-7f10-4eb4-9c61-5599af55c882 tempest-ServersNegativeTestJSON-1126403732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d41bcdef-1daf-4fd0-a828-cae4f6bb5e9b" returned: 0 in 0.735s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:46:57 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-62549566-7f10-4eb4-9c61-5599af55c882 tempest-ServersNegativeTestJSON-1126403732 None] <== create_volume: return (2043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:46:57 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-62549566-7f10-4eb4-9c61-5599af55c882 tempest-ServersNegativeTestJSON-1126403732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.049s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:46:57 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-62549566-7f10-4eb4-9c61-5599af55c882 tempest-ServersNegativeTestJSON-1126403732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac7c909a-9e69-474b-8be0-c3d1e1ca65d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d41bcdef-1daf-4fd0-a828-cae4f6bb5e9b', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:46:57 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-62549566-7f10-4eb4-9c61-5599af55c882 tempest-ServersNegativeTestJSON-1126403732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (165e93d2-bfeb-49a8-a942-2844e991800d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:46:57 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-62549566-7f10-4eb4-9c61-5599af55c882 tempest-ServersNegativeTestJSON-1126403732 None] Volume volume-d41bcdef-1daf-4fd0-a828-cae4f6bb5e9b (d41bcdef-1daf-4fd0-a828-cae4f6bb5e9b): created successfully Apr 24 13:46:57 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-62549566-7f10-4eb4-9c61-5599af55c882 tempest-ServersNegativeTestJSON-1126403732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (165e93d2-bfeb-49a8-a942-2844e991800d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:46:57 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-62549566-7f10-4eb4-9c61-5599af55c882 tempest-ServersNegativeTestJSON-1126403732 None] Flow 'volume_create_manager' (06fb29c4-fcae-49bd-95eb-7a8c3944bd86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:46:57 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-62549566-7f10-4eb4-9c61-5599af55c882 tempest-ServersNegativeTestJSON-1126403732 None] Created volume successfully. Apr 24 13:47:00 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-34e1cfde-d117-4aa9-b577-3f5d2c3760f7 tempest-ServersNegativeTestJSON-1126403732 None] Acquiring lock "cinder-d41bcdef-1daf-4fd0-a828-cae4f6bb5e9b-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:47:00 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-34e1cfde-d117-4aa9-b577-3f5d2c3760f7 tempest-ServersNegativeTestJSON-1126403732 None] Lock "cinder-d41bcdef-1daf-4fd0-a828-cae4f6bb5e9b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:47:00 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-34e1cfde-d117-4aa9-b577-3f5d2c3760f7 tempest-ServersNegativeTestJSON-1126403732 None] Acquiring lock "cinder-quobyte-d41bcdef-1daf-4fd0-a828-cae4f6bb5e9b" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:47:00 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-34e1cfde-d117-4aa9-b577-3f5d2c3760f7 tempest-ServersNegativeTestJSON-1126403732 None] Lock "cinder-quobyte-d41bcdef-1daf-4fd0-a828-cae4f6bb5e9b" acquired by "delete_volume" :: waited 0.021s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:47:00 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[674a9954-447f-4809-8533-624b60e70b14]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:47:00 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-34e1cfde-d117-4aa9-b577-3f5d2c3760f7 tempest-ServersNegativeTestJSON-1126403732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d41bcdef-1daf-4fd0-a828-cae4f6bb5e9b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:47:00 devstack sudo[85022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d41bcdef-1daf-4fd0-a828-cae4f6bb5e9b Apr 24 13:47:00 devstack sudo[85022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:47:01 devstack sudo[85022]: pam_unix(sudo:session): session closed for user root Apr 24 13:47:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-34e1cfde-d117-4aa9-b577-3f5d2c3760f7 tempest-ServersNegativeTestJSON-1126403732 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d41bcdef-1daf-4fd0-a828-cae4f6bb5e9b" returned: 0 in 0.900s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:47:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-34e1cfde-d117-4aa9-b577-3f5d2c3760f7 tempest-ServersNegativeTestJSON-1126403732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d41bcdef-1daf-4fd0-a828-cae4f6bb5e9b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:47:01 devstack sudo[85030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d41bcdef-1daf-4fd0-a828-cae4f6bb5e9b Apr 24 13:47:01 devstack sudo[85030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:47:02 devstack sudo[85030]: pam_unix(sudo:session): session closed for user root Apr 24 13:47:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-34e1cfde-d117-4aa9-b577-3f5d2c3760f7 tempest-ServersNegativeTestJSON-1126403732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d41bcdef-1daf-4fd0-a828-cae4f6bb5e9b" returned: 0 in 0.710s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:47:02 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-34e1cfde-d117-4aa9-b577-3f5d2c3760f7 tempest-ServersNegativeTestJSON-1126403732 None] Lock "cinder-quobyte-d41bcdef-1daf-4fd0-a828-cae4f6bb5e9b" released by "delete_volume" :: held 1.670s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:47:02 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-34e1cfde-d117-4aa9-b577-3f5d2c3760f7 tempest-ServersNegativeTestJSON-1126403732 None] Created reservations ['e7a2a82a-a157-4d07-b2d8-f3f4c6231ace', 'ebe2b4b7-f6fb-4a39-819b-c04f6610db4a', '012f8db2-5d32-44d1-9d1a-bd098263e0cb', 'b537007c-0dc1-47d9-81dc-80b2e87c19d9'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:47:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-34e1cfde-d117-4aa9-b577-3f5d2c3760f7 tempest-ServersNegativeTestJSON-1126403732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:47:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-34e1cfde-d117-4aa9-b577-3f5d2c3760f7 tempest-ServersNegativeTestJSON-1126403732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:47:02 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-34e1cfde-d117-4aa9-b577-3f5d2c3760f7 tempest-ServersNegativeTestJSON-1126403732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:47:02 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-34e1cfde-d117-4aa9-b577-3f5d2c3760f7 tempest-ServersNegativeTestJSON-1126403732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:47:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-34e1cfde-d117-4aa9-b577-3f5d2c3760f7 tempest-ServersNegativeTestJSON-1126403732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:47:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-34e1cfde-d117-4aa9-b577-3f5d2c3760f7 tempest-ServersNegativeTestJSON-1126403732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:47:02 devstack sudo[85044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:47:02 devstack sudo[85044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:47:02 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-2a3791bd-3b31-4a86-b08a-93cbc112232d tempest-ServersNegativeTestJSON-1126403732 None] Acquiring lock "cinder-197189db-32f3-4276-8294-307de48ddb43-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:47:02 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-2a3791bd-3b31-4a86-b08a-93cbc112232d tempest-ServersNegativeTestJSON-1126403732 None] Lock "cinder-197189db-32f3-4276-8294-307de48ddb43-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:47:02 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-2a3791bd-3b31-4a86-b08a-93cbc112232d tempest-ServersNegativeTestJSON-1126403732 None] Acquiring lock "cinder-quobyte-197189db-32f3-4276-8294-307de48ddb43" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:47:02 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-2a3791bd-3b31-4a86-b08a-93cbc112232d tempest-ServersNegativeTestJSON-1126403732 None] Lock "cinder-quobyte-197189db-32f3-4276-8294-307de48ddb43" acquired by "delete_volume" :: waited 0.049s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:47:02 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[6097bb98-b094-44ff-af47-b1c98d9e273e]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:47:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2a3791bd-3b31-4a86-b08a-93cbc112232d tempest-ServersNegativeTestJSON-1126403732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-197189db-32f3-4276-8294-307de48ddb43 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:47:03 devstack sudo[85056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-197189db-32f3-4276-8294-307de48ddb43 Apr 24 13:47:03 devstack sudo[85056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:47:03 devstack sudo[85044]: pam_unix(sudo:session): session closed for user root Apr 24 13:47:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-34e1cfde-d117-4aa9-b577-3f5d2c3760f7 tempest-ServersNegativeTestJSON-1126403732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.778s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:47:03 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-34e1cfde-d117-4aa9-b577-3f5d2c3760f7 tempest-ServersNegativeTestJSON-1126403732 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:47:03 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-34e1cfde-d117-4aa9-b577-3f5d2c3760f7 tempest-ServersNegativeTestJSON-1126403732 None] Deleted volume successfully. Apr 24 13:47:03 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-34e1cfde-d117-4aa9-b577-3f5d2c3760f7 tempest-ServersNegativeTestJSON-1126403732 None] Lock "cinder-d41bcdef-1daf-4fd0-a828-cae4f6bb5e9b-delete_volume" released by "delete_volume" :: held 2.806s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:47:03 devstack sudo[85056]: pam_unix(sudo:session): session closed for user root Apr 24 13:47:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2a3791bd-3b31-4a86-b08a-93cbc112232d tempest-ServersNegativeTestJSON-1126403732 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-197189db-32f3-4276-8294-307de48ddb43" returned: 0 in 0.889s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:47:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2a3791bd-3b31-4a86-b08a-93cbc112232d tempest-ServersNegativeTestJSON-1126403732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-197189db-32f3-4276-8294-307de48ddb43 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:47:03 devstack sudo[85061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-197189db-32f3-4276-8294-307de48ddb43 Apr 24 13:47:03 devstack sudo[85061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:47:04 devstack sudo[85061]: pam_unix(sudo:session): session closed for user root Apr 24 13:47:04 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2a3791bd-3b31-4a86-b08a-93cbc112232d tempest-ServersNegativeTestJSON-1126403732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-197189db-32f3-4276-8294-307de48ddb43" returned: 0 in 0.709s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:47:04 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-2a3791bd-3b31-4a86-b08a-93cbc112232d tempest-ServersNegativeTestJSON-1126403732 None] Lock "cinder-quobyte-197189db-32f3-4276-8294-307de48ddb43" released by "delete_volume" :: held 1.654s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:47:04 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-2a3791bd-3b31-4a86-b08a-93cbc112232d tempest-ServersNegativeTestJSON-1126403732 None] Created reservations ['e6219f90-5ac0-4252-bc67-4cbc3d4334a0', '818f80a6-17f4-4b11-9ebe-669bb912dff9', '114cdde3-8af0-4f56-abb0-61446f516162', 'd51562bd-68cc-42a2-ba3f-335f84f3e971'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:47:04 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-2a3791bd-3b31-4a86-b08a-93cbc112232d tempest-ServersNegativeTestJSON-1126403732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:47:04 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-2a3791bd-3b31-4a86-b08a-93cbc112232d tempest-ServersNegativeTestJSON-1126403732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:47:04 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-2a3791bd-3b31-4a86-b08a-93cbc112232d tempest-ServersNegativeTestJSON-1126403732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:47:04 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-2a3791bd-3b31-4a86-b08a-93cbc112232d tempest-ServersNegativeTestJSON-1126403732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:47:04 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-2a3791bd-3b31-4a86-b08a-93cbc112232d tempest-ServersNegativeTestJSON-1126403732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:47:04 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2a3791bd-3b31-4a86-b08a-93cbc112232d tempest-ServersNegativeTestJSON-1126403732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:47:04 devstack sudo[85088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:47:04 devstack sudo[85088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:47:05 devstack sudo[85088]: pam_unix(sudo:session): session closed for user root Apr 24 13:47:05 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2a3791bd-3b31-4a86-b08a-93cbc112232d tempest-ServersNegativeTestJSON-1126403732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.785s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:47:05 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-2a3791bd-3b31-4a86-b08a-93cbc112232d tempest-ServersNegativeTestJSON-1126403732 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:47:05 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-2a3791bd-3b31-4a86-b08a-93cbc112232d tempest-ServersNegativeTestJSON-1126403732 None] Deleted volume successfully. Apr 24 13:47:05 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-2a3791bd-3b31-4a86-b08a-93cbc112232d tempest-ServersNegativeTestJSON-1126403732 None] Lock "cinder-197189db-32f3-4276-8294-307de48ddb43-delete_volume" released by "delete_volume" :: held 2.890s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:47:12 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-52777b3c-91f1-4184-b27f-b0f833f64dbe tempest-GroupsV320Test-1078102832 None] Group tempest-GroupsV320Test-Group-993245189: creating Apr 24 13:47:12 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-52777b3c-91f1-4184-b27f-b0f833f64dbe tempest-GroupsV320Test-1078102832 None] Group tempest-GroupsV320Test-Group-993245189: created successfully Apr 24 13:47:12 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-52777b3c-91f1-4184-b27f-b0f833f64dbe tempest-GroupsV320Test-1078102832 None] Create group completed successfully. Apr 24 13:47:13 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cc6b0b5-657f-4f39-b5d2-02abf65d1e0b tempest-VolumeQuotasAdminTestJSON-965762419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:47:13 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5cc6b0b5-657f-4f39-b5d2-02abf65d1e0b tempest-VolumeQuotasAdminTestJSON-965762419 None] Flow 'volume_create_manager' (5b5fc8be-7bc5-4a82-88d4-dc7138a02769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:47:13 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5cc6b0b5-657f-4f39-b5d2-02abf65d1e0b tempest-VolumeQuotasAdminTestJSON-965762419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90b0d945-ba0f-4dcf-8cc3-7bb3d241eb0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:47:13 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5cc6b0b5-657f-4f39-b5d2-02abf65d1e0b tempest-VolumeQuotasAdminTestJSON-965762419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90b0d945-ba0f-4dcf-8cc3-7bb3d241eb0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:47:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-899817267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5774e029-be53-40b7-b7b8-27ede7a582a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='473dca3b9ac346fcb456069186e6a503',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:47:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:47:14Z,use_quota=True,user_id='92d076ef55784e10a5398ae96a41dec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:47:13 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5cc6b0b5-657f-4f39-b5d2-02abf65d1e0b tempest-VolumeQuotasAdminTestJSON-965762419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e847cfb2-24fc-4ec0-aeb9-adc6eaf746aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:47:13 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5cc6b0b5-657f-4f39-b5d2-02abf65d1e0b tempest-VolumeQuotasAdminTestJSON-965762419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e847cfb2-24fc-4ec0-aeb9-adc6eaf746aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:47:13 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5cc6b0b5-657f-4f39-b5d2-02abf65d1e0b tempest-VolumeQuotasAdminTestJSON-965762419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41446ec2-e632-4ecd-a03c-80026e434195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:47:13 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5cc6b0b5-657f-4f39-b5d2-02abf65d1e0b tempest-VolumeQuotasAdminTestJSON-965762419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41446ec2-e632-4ecd-a03c-80026e434195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5774e029-be53-40b7-b7b8-27ede7a582a6', 'volume_name': 'volume-5774e029-be53-40b7-b7b8-27ede7a582a6', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:47:14 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5cc6b0b5-657f-4f39-b5d2-02abf65d1e0b tempest-VolumeQuotasAdminTestJSON-965762419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f1530fa-eebd-4314-aaee-4b758554adcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:47:14 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5cc6b0b5-657f-4f39-b5d2-02abf65d1e0b tempest-VolumeQuotasAdminTestJSON-965762419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f1530fa-eebd-4314-aaee-4b758554adcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:47:14 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5cc6b0b5-657f-4f39-b5d2-02abf65d1e0b tempest-VolumeQuotasAdminTestJSON-965762419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21ec4c64-c2f6-4546-a0f1-ca322ed2c30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:47:14 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-5cc6b0b5-657f-4f39-b5d2-02abf65d1e0b tempest-VolumeQuotasAdminTestJSON-965762419 None] Volume 5774e029-be53-40b7-b7b8-27ede7a582a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5774e029-be53-40b7-b7b8-27ede7a582a6', 'volume_size': 1} Apr 24 13:47:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5cc6b0b5-657f-4f39-b5d2-02abf65d1e0b tempest-VolumeQuotasAdminTestJSON-965762419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:47:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5cc6b0b5-657f-4f39-b5d2-02abf65d1e0b tempest-VolumeQuotasAdminTestJSON-965762419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:47:14 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-5cc6b0b5-657f-4f39-b5d2-02abf65d1e0b tempest-VolumeQuotasAdminTestJSON-965762419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:47:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-899817267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5774e029-be53-40b7-b7b8-27ede7a582a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='473dca3b9ac346fcb456069186e6a503',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:47:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:47:14Z,use_quota=True,user_id='92d076ef55784e10a5398ae96a41dec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:47:14 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-5cc6b0b5-657f-4f39-b5d2-02abf65d1e0b tempest-VolumeQuotasAdminTestJSON-965762419 None] Creating volume 5774e029-be53-40b7-b7b8-27ede7a582a6 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:47:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5cc6b0b5-657f-4f39-b5d2-02abf65d1e0b tempest-VolumeQuotasAdminTestJSON-965762419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:47:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5cc6b0b5-657f-4f39-b5d2-02abf65d1e0b tempest-VolumeQuotasAdminTestJSON-965762419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:47:14 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-5cc6b0b5-657f-4f39-b5d2-02abf65d1e0b tempest-VolumeQuotasAdminTestJSON-965762419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:47:14 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-5cc6b0b5-657f-4f39-b5d2-02abf65d1e0b tempest-VolumeQuotasAdminTestJSON-965762419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:47:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5cc6b0b5-657f-4f39-b5d2-02abf65d1e0b tempest-VolumeQuotasAdminTestJSON-965762419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:47:14 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-5cc6b0b5-657f-4f39-b5d2-02abf65d1e0b tempest-VolumeQuotasAdminTestJSON-965762419 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:47:14 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-5cc6b0b5-657f-4f39-b5d2-02abf65d1e0b tempest-VolumeQuotasAdminTestJSON-965762419 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:47:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5cc6b0b5-657f-4f39-b5d2-02abf65d1e0b tempest-VolumeQuotasAdminTestJSON-965762419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5774e029-be53-40b7-b7b8-27ede7a582a6 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:47:14 devstack sudo[85218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5774e029-be53-40b7-b7b8-27ede7a582a6 1073741824 Apr 24 13:47:14 devstack sudo[85218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:47:14 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-a05aea87-551f-4325-83bb-91e4747b316c tempest-GroupsV320Test-1078102832 None] Created reservations ['6dff2740-ff50-4d5c-9645-bffa89d6d2b2'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:47:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a05aea87-551f-4325-83bb-91e4747b316c tempest-GroupsV320Test-1078102832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:47:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a05aea87-551f-4325-83bb-91e4747b316c tempest-GroupsV320Test-1078102832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:47:14 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a05aea87-551f-4325-83bb-91e4747b316c tempest-GroupsV320Test-1078102832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:47:14 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a05aea87-551f-4325-83bb-91e4747b316c tempest-GroupsV320Test-1078102832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:47:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a05aea87-551f-4325-83bb-91e4747b316c tempest-GroupsV320Test-1078102832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:47:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a05aea87-551f-4325-83bb-91e4747b316c tempest-GroupsV320Test-1078102832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:47:15 devstack sudo[85255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:47:15 devstack sudo[85255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:47:15 devstack sudo[85218]: pam_unix(sudo:session): session closed for user root Apr 24 13:47:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5cc6b0b5-657f-4f39-b5d2-02abf65d1e0b tempest-VolumeQuotasAdminTestJSON-965762419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5774e029-be53-40b7-b7b8-27ede7a582a6 1073741824" returned: 0 in 1.155s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:47:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5cc6b0b5-657f-4f39-b5d2-02abf65d1e0b tempest-VolumeQuotasAdminTestJSON-965762419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5774e029-be53-40b7-b7b8-27ede7a582a6 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:47:15 devstack sudo[85259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5774e029-be53-40b7-b7b8-27ede7a582a6 Apr 24 13:47:15 devstack sudo[85259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:47:15 devstack sudo[85255]: pam_unix(sudo:session): session closed for user root Apr 24 13:47:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a05aea87-551f-4325-83bb-91e4747b316c tempest-GroupsV320Test-1078102832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.595s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:47:15 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-a05aea87-551f-4325-83bb-91e4747b316c tempest-GroupsV320Test-1078102832 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:47:15 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-a05aea87-551f-4325-83bb-91e4747b316c tempest-GroupsV320Test-1078102832 None] Delete group completed successfully. Apr 24 13:47:15 devstack sudo[85259]: pam_unix(sudo:session): session closed for user root Apr 24 13:47:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5cc6b0b5-657f-4f39-b5d2-02abf65d1e0b tempest-VolumeQuotasAdminTestJSON-965762419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5774e029-be53-40b7-b7b8-27ede7a582a6" returned: 0 in 0.563s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:47:15 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-5cc6b0b5-657f-4f39-b5d2-02abf65d1e0b tempest-VolumeQuotasAdminTestJSON-965762419 None] <== create_volume: return (1820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:47:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5cc6b0b5-657f-4f39-b5d2-02abf65d1e0b tempest-VolumeQuotasAdminTestJSON-965762419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.831s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:47:15 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5cc6b0b5-657f-4f39-b5d2-02abf65d1e0b tempest-VolumeQuotasAdminTestJSON-965762419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21ec4c64-c2f6-4546-a0f1-ca322ed2c30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5774e029-be53-40b7-b7b8-27ede7a582a6', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:47:15 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5cc6b0b5-657f-4f39-b5d2-02abf65d1e0b tempest-VolumeQuotasAdminTestJSON-965762419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22017cc0-c81f-4d74-b0f3-4e5252131f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:47:15 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-5cc6b0b5-657f-4f39-b5d2-02abf65d1e0b tempest-VolumeQuotasAdminTestJSON-965762419 None] Volume volume-5774e029-be53-40b7-b7b8-27ede7a582a6 (5774e029-be53-40b7-b7b8-27ede7a582a6): created successfully Apr 24 13:47:15 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5cc6b0b5-657f-4f39-b5d2-02abf65d1e0b tempest-VolumeQuotasAdminTestJSON-965762419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22017cc0-c81f-4d74-b0f3-4e5252131f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:47:15 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5cc6b0b5-657f-4f39-b5d2-02abf65d1e0b tempest-VolumeQuotasAdminTestJSON-965762419 None] Flow 'volume_create_manager' (5b5fc8be-7bc5-4a82-88d4-dc7138a02769) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:47:15 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-5cc6b0b5-657f-4f39-b5d2-02abf65d1e0b tempest-VolumeQuotasAdminTestJSON-965762419 None] Created volume successfully. Apr 24 13:47:17 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-8fe67ba6-df2c-456f-8cc5-fc495fa545fa tempest-VolumeQuotasAdminTestJSON-965762419 None] Acquiring lock "cinder-5774e029-be53-40b7-b7b8-27ede7a582a6-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:47:17 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-8fe67ba6-df2c-456f-8cc5-fc495fa545fa tempest-VolumeQuotasAdminTestJSON-965762419 None] Lock "cinder-5774e029-be53-40b7-b7b8-27ede7a582a6-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:47:17 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-8fe67ba6-df2c-456f-8cc5-fc495fa545fa tempest-VolumeQuotasAdminTestJSON-965762419 None] Acquiring lock "cinder-quobyte-5774e029-be53-40b7-b7b8-27ede7a582a6" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:47:17 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-8fe67ba6-df2c-456f-8cc5-fc495fa545fa tempest-VolumeQuotasAdminTestJSON-965762419 None] Lock "cinder-quobyte-5774e029-be53-40b7-b7b8-27ede7a582a6" acquired by "delete_volume" :: waited 0.021s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:47:17 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c9df93-f424-4e17-8e7a-88bb32179460]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:47:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8fe67ba6-df2c-456f-8cc5-fc495fa545fa tempest-VolumeQuotasAdminTestJSON-965762419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5774e029-be53-40b7-b7b8-27ede7a582a6 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:47:17 devstack sudo[85295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5774e029-be53-40b7-b7b8-27ede7a582a6 Apr 24 13:47:17 devstack sudo[85295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:47:18 devstack sudo[85295]: pam_unix(sudo:session): session closed for user root Apr 24 13:47:18 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8fe67ba6-df2c-456f-8cc5-fc495fa545fa tempest-VolumeQuotasAdminTestJSON-965762419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5774e029-be53-40b7-b7b8-27ede7a582a6" returned: 0 in 0.978s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:47:18 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8fe67ba6-df2c-456f-8cc5-fc495fa545fa tempest-VolumeQuotasAdminTestJSON-965762419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5774e029-be53-40b7-b7b8-27ede7a582a6 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:47:18 devstack sudo[85315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5774e029-be53-40b7-b7b8-27ede7a582a6 Apr 24 13:47:18 devstack sudo[85315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:47:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8fe67ba6-df2c-456f-8cc5-fc495fa545fa tempest-VolumeQuotasAdminTestJSON-965762419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5774e029-be53-40b7-b7b8-27ede7a582a6" returned: 0 in 0.993s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:47:19 devstack sudo[85315]: pam_unix(sudo:session): session closed for user root Apr 24 13:47:19 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-8fe67ba6-df2c-456f-8cc5-fc495fa545fa tempest-VolumeQuotasAdminTestJSON-965762419 None] Lock "cinder-quobyte-5774e029-be53-40b7-b7b8-27ede7a582a6" released by "delete_volume" :: held 2.059s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:47:19 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-8fe67ba6-df2c-456f-8cc5-fc495fa545fa tempest-VolumeQuotasAdminTestJSON-965762419 None] Created reservations ['bd8a99ab-3457-4cea-ace3-5103b81a70b5', 'ee2a50d0-a239-4f18-a02e-5c01e3ced54c', '463ec09d-3cee-4216-bacc-cc80d41a97b2', '2f5600bb-9180-40d0-a8f7-a5249dfb876d'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:47:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-8fe67ba6-df2c-456f-8cc5-fc495fa545fa tempest-VolumeQuotasAdminTestJSON-965762419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:47:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-8fe67ba6-df2c-456f-8cc5-fc495fa545fa tempest-VolumeQuotasAdminTestJSON-965762419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:47:19 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-8fe67ba6-df2c-456f-8cc5-fc495fa545fa tempest-VolumeQuotasAdminTestJSON-965762419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:47:19 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-8fe67ba6-df2c-456f-8cc5-fc495fa545fa tempest-VolumeQuotasAdminTestJSON-965762419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:47:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-8fe67ba6-df2c-456f-8cc5-fc495fa545fa tempest-VolumeQuotasAdminTestJSON-965762419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:47:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8fe67ba6-df2c-456f-8cc5-fc495fa545fa tempest-VolumeQuotasAdminTestJSON-965762419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:47:19 devstack sudo[85320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:47:19 devstack sudo[85320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:47:20 devstack sudo[85320]: pam_unix(sudo:session): session closed for user root Apr 24 13:47:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8fe67ba6-df2c-456f-8cc5-fc495fa545fa tempest-VolumeQuotasAdminTestJSON-965762419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.767s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:47:20 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-8fe67ba6-df2c-456f-8cc5-fc495fa545fa tempest-VolumeQuotasAdminTestJSON-965762419 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:47:20 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-8fe67ba6-df2c-456f-8cc5-fc495fa545fa tempest-VolumeQuotasAdminTestJSON-965762419 None] Deleted volume successfully. Apr 24 13:47:20 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-8fe67ba6-df2c-456f-8cc5-fc495fa545fa tempest-VolumeQuotasAdminTestJSON-965762419 None] Lock "cinder-5774e029-be53-40b7-b7b8-27ede7a582a6-delete_volume" released by "delete_volume" :: held 3.189s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:47:21 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f9cdffb-10f0-4078-b600-b494534f7fd9 tempest-VolumeQuotasAdminTestJSON-965762419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:47:21 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4f9cdffb-10f0-4078-b600-b494534f7fd9 tempest-VolumeQuotasAdminTestJSON-965762419 None] Flow 'volume_create_manager' (6629f618-fb25-4228-b32e-86d0ec52a4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:47:21 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4f9cdffb-10f0-4078-b600-b494534f7fd9 tempest-VolumeQuotasAdminTestJSON-965762419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e6e2ed4-b57e-493a-9235-3c0ff5794f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:47:21 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4f9cdffb-10f0-4078-b600-b494534f7fd9 tempest-VolumeQuotasAdminTestJSON-965762419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e6e2ed4-b57e-493a-9235-3c0ff5794f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1622191292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=654fefe9-d5ae-4c01-9b77-f6b5f52a79d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='473dca3b9ac346fcb456069186e6a503',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:47:22Z,use_quota=True,user_id='92d076ef55784e10a5398ae96a41dec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:47:21 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4f9cdffb-10f0-4078-b600-b494534f7fd9 tempest-VolumeQuotasAdminTestJSON-965762419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35eacce6-dfe5-490b-a72f-bb97b08bb872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:47:21 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4f9cdffb-10f0-4078-b600-b494534f7fd9 tempest-VolumeQuotasAdminTestJSON-965762419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35eacce6-dfe5-490b-a72f-bb97b08bb872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:47:21 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4f9cdffb-10f0-4078-b600-b494534f7fd9 tempest-VolumeQuotasAdminTestJSON-965762419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba36897c-08df-4c15-a82a-63856674164e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:47:21 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4f9cdffb-10f0-4078-b600-b494534f7fd9 tempest-VolumeQuotasAdminTestJSON-965762419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba36897c-08df-4c15-a82a-63856674164e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '654fefe9-d5ae-4c01-9b77-f6b5f52a79d2', 'volume_name': 'volume-654fefe9-d5ae-4c01-9b77-f6b5f52a79d2', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:47:21 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4f9cdffb-10f0-4078-b600-b494534f7fd9 tempest-VolumeQuotasAdminTestJSON-965762419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7525908f-8355-47f5-8972-c1a18175da0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:47:21 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4f9cdffb-10f0-4078-b600-b494534f7fd9 tempest-VolumeQuotasAdminTestJSON-965762419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7525908f-8355-47f5-8972-c1a18175da0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:47:21 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4f9cdffb-10f0-4078-b600-b494534f7fd9 tempest-VolumeQuotasAdminTestJSON-965762419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f881cb35-ae45-4bf0-8d77-4a081492afed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:47:21 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-4f9cdffb-10f0-4078-b600-b494534f7fd9 tempest-VolumeQuotasAdminTestJSON-965762419 None] Volume 654fefe9-d5ae-4c01-9b77-f6b5f52a79d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-654fefe9-d5ae-4c01-9b77-f6b5f52a79d2', 'volume_size': 1} Apr 24 13:47:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4f9cdffb-10f0-4078-b600-b494534f7fd9 tempest-VolumeQuotasAdminTestJSON-965762419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:47:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4f9cdffb-10f0-4078-b600-b494534f7fd9 tempest-VolumeQuotasAdminTestJSON-965762419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:47:21 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-4f9cdffb-10f0-4078-b600-b494534f7fd9 tempest-VolumeQuotasAdminTestJSON-965762419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1622191292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=654fefe9-d5ae-4c01-9b77-f6b5f52a79d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='473dca3b9ac346fcb456069186e6a503',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:47:22Z,use_quota=True,user_id='92d076ef55784e10a5398ae96a41dec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:47:21 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-4f9cdffb-10f0-4078-b600-b494534f7fd9 tempest-VolumeQuotasAdminTestJSON-965762419 None] Creating volume 654fefe9-d5ae-4c01-9b77-f6b5f52a79d2 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:47:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4f9cdffb-10f0-4078-b600-b494534f7fd9 tempest-VolumeQuotasAdminTestJSON-965762419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:47:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4f9cdffb-10f0-4078-b600-b494534f7fd9 tempest-VolumeQuotasAdminTestJSON-965762419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:47:21 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-4f9cdffb-10f0-4078-b600-b494534f7fd9 tempest-VolumeQuotasAdminTestJSON-965762419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:47:21 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-4f9cdffb-10f0-4078-b600-b494534f7fd9 tempest-VolumeQuotasAdminTestJSON-965762419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:47:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4f9cdffb-10f0-4078-b600-b494534f7fd9 tempest-VolumeQuotasAdminTestJSON-965762419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:47:21 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-4f9cdffb-10f0-4078-b600-b494534f7fd9 tempest-VolumeQuotasAdminTestJSON-965762419 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:47:21 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-4f9cdffb-10f0-4078-b600-b494534f7fd9 tempest-VolumeQuotasAdminTestJSON-965762419 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:47:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4f9cdffb-10f0-4078-b600-b494534f7fd9 tempest-VolumeQuotasAdminTestJSON-965762419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-654fefe9-d5ae-4c01-9b77-f6b5f52a79d2 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:47:21 devstack sudo[85324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-654fefe9-d5ae-4c01-9b77-f6b5f52a79d2 1073741824 Apr 24 13:47:21 devstack sudo[85324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:47:22 devstack sudo[85324]: pam_unix(sudo:session): session closed for user root Apr 24 13:47:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4f9cdffb-10f0-4078-b600-b494534f7fd9 tempest-VolumeQuotasAdminTestJSON-965762419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-654fefe9-d5ae-4c01-9b77-f6b5f52a79d2 1073741824" returned: 0 in 1.029s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:47:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4f9cdffb-10f0-4078-b600-b494534f7fd9 tempest-VolumeQuotasAdminTestJSON-965762419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-654fefe9-d5ae-4c01-9b77-f6b5f52a79d2 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:47:22 devstack sudo[85334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-654fefe9-d5ae-4c01-9b77-f6b5f52a79d2 Apr 24 13:47:22 devstack sudo[85334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:47:23 devstack sudo[85334]: pam_unix(sudo:session): session closed for user root Apr 24 13:47:23 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4f9cdffb-10f0-4078-b600-b494534f7fd9 tempest-VolumeQuotasAdminTestJSON-965762419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-654fefe9-d5ae-4c01-9b77-f6b5f52a79d2" returned: 0 in 0.810s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:47:23 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-4f9cdffb-10f0-4078-b600-b494534f7fd9 tempest-VolumeQuotasAdminTestJSON-965762419 None] <== create_volume: return (1883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:47:23 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4f9cdffb-10f0-4078-b600-b494534f7fd9 tempest-VolumeQuotasAdminTestJSON-965762419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.886s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:47:23 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4f9cdffb-10f0-4078-b600-b494534f7fd9 tempest-VolumeQuotasAdminTestJSON-965762419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f881cb35-ae45-4bf0-8d77-4a081492afed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-654fefe9-d5ae-4c01-9b77-f6b5f52a79d2', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:47:23 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4f9cdffb-10f0-4078-b600-b494534f7fd9 tempest-VolumeQuotasAdminTestJSON-965762419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b725500-73f2-4901-aa35-71dabc8ecd56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:47:23 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-4f9cdffb-10f0-4078-b600-b494534f7fd9 tempest-VolumeQuotasAdminTestJSON-965762419 None] Volume volume-654fefe9-d5ae-4c01-9b77-f6b5f52a79d2 (654fefe9-d5ae-4c01-9b77-f6b5f52a79d2): created successfully Apr 24 13:47:23 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4f9cdffb-10f0-4078-b600-b494534f7fd9 tempest-VolumeQuotasAdminTestJSON-965762419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b725500-73f2-4901-aa35-71dabc8ecd56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:47:23 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4f9cdffb-10f0-4078-b600-b494534f7fd9 tempest-VolumeQuotasAdminTestJSON-965762419 None] Flow 'volume_create_manager' (6629f618-fb25-4228-b32e-86d0ec52a4e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:47:23 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-4f9cdffb-10f0-4078-b600-b494534f7fd9 tempest-VolumeQuotasAdminTestJSON-965762419 None] Created volume successfully. Apr 24 13:47:26 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-064d36b8-5809-4f21-b742-6aecc7b61db0 tempest-VolumeQuotasAdminTestJSON-1866014253 None] Transfer volume completed successfully. Apr 24 13:47:27 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-9691f6a2-388a-4462-b229-d92aa32bdbdb tempest-VolumeQuotasAdminTestJSON-63014630 None] Acquiring lock "cinder-654fefe9-d5ae-4c01-9b77-f6b5f52a79d2-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:47:27 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-9691f6a2-388a-4462-b229-d92aa32bdbdb tempest-VolumeQuotasAdminTestJSON-63014630 None] Lock "cinder-654fefe9-d5ae-4c01-9b77-f6b5f52a79d2-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:47:27 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-9691f6a2-388a-4462-b229-d92aa32bdbdb tempest-VolumeQuotasAdminTestJSON-63014630 None] Acquiring lock "cinder-quobyte-654fefe9-d5ae-4c01-9b77-f6b5f52a79d2" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:47:27 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-9691f6a2-388a-4462-b229-d92aa32bdbdb tempest-VolumeQuotasAdminTestJSON-63014630 None] Lock "cinder-quobyte-654fefe9-d5ae-4c01-9b77-f6b5f52a79d2" acquired by "delete_volume" :: waited 0.013s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:47:27 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f05117d-861a-4537-8d18-8f0149a22ca2]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:47:27 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-9691f6a2-388a-4462-b229-d92aa32bdbdb tempest-VolumeQuotasAdminTestJSON-63014630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-654fefe9-d5ae-4c01-9b77-f6b5f52a79d2 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:47:27 devstack sudo[85340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-654fefe9-d5ae-4c01-9b77-f6b5f52a79d2 Apr 24 13:47:27 devstack sudo[85340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:47:28 devstack sudo[85340]: pam_unix(sudo:session): session closed for user root Apr 24 13:47:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-9691f6a2-388a-4462-b229-d92aa32bdbdb tempest-VolumeQuotasAdminTestJSON-63014630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-654fefe9-d5ae-4c01-9b77-f6b5f52a79d2" returned: 0 in 0.885s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:47:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-9691f6a2-388a-4462-b229-d92aa32bdbdb tempest-VolumeQuotasAdminTestJSON-63014630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-654fefe9-d5ae-4c01-9b77-f6b5f52a79d2 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:47:28 devstack sudo[85345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-654fefe9-d5ae-4c01-9b77-f6b5f52a79d2 Apr 24 13:47:28 devstack sudo[85345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:47:28 devstack sudo[85345]: pam_unix(sudo:session): session closed for user root Apr 24 13:47:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-9691f6a2-388a-4462-b229-d92aa32bdbdb tempest-VolumeQuotasAdminTestJSON-63014630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-654fefe9-d5ae-4c01-9b77-f6b5f52a79d2" returned: 0 in 0.757s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:47:28 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-9691f6a2-388a-4462-b229-d92aa32bdbdb tempest-VolumeQuotasAdminTestJSON-63014630 None] Lock "cinder-quobyte-654fefe9-d5ae-4c01-9b77-f6b5f52a79d2" released by "delete_volume" :: held 1.699s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:47:29 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-9691f6a2-388a-4462-b229-d92aa32bdbdb tempest-VolumeQuotasAdminTestJSON-63014630 None] Created reservations ['e546e851-81c0-4144-b3b3-037e8e44699e', '2a58dbe8-1c4c-466e-8883-d1d1e8555ada', 'b6080c87-2ebf-4245-993d-8c5229455570', '9483345f-d723-4196-9d25-7c1f4ccc5f10'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:47:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-9691f6a2-388a-4462-b229-d92aa32bdbdb tempest-VolumeQuotasAdminTestJSON-63014630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:47:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-9691f6a2-388a-4462-b229-d92aa32bdbdb tempest-VolumeQuotasAdminTestJSON-63014630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:47:29 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-9691f6a2-388a-4462-b229-d92aa32bdbdb tempest-VolumeQuotasAdminTestJSON-63014630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:47:29 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-9691f6a2-388a-4462-b229-d92aa32bdbdb tempest-VolumeQuotasAdminTestJSON-63014630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:47:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-9691f6a2-388a-4462-b229-d92aa32bdbdb tempest-VolumeQuotasAdminTestJSON-63014630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:47:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-9691f6a2-388a-4462-b229-d92aa32bdbdb tempest-VolumeQuotasAdminTestJSON-63014630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:47:29 devstack sudo[85348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:47:29 devstack sudo[85348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:47:30 devstack sudo[85348]: pam_unix(sudo:session): session closed for user root Apr 24 13:47:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-9691f6a2-388a-4462-b229-d92aa32bdbdb tempest-VolumeQuotasAdminTestJSON-63014630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 1.165s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:47:30 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-9691f6a2-388a-4462-b229-d92aa32bdbdb tempest-VolumeQuotasAdminTestJSON-63014630 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:47:30 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-9691f6a2-388a-4462-b229-d92aa32bdbdb tempest-VolumeQuotasAdminTestJSON-63014630 None] Deleted volume successfully. Apr 24 13:47:30 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-9691f6a2-388a-4462-b229-d92aa32bdbdb tempest-VolumeQuotasAdminTestJSON-63014630 None] Lock "cinder-654fefe9-d5ae-4c01-9b77-f6b5f52a79d2-delete_volume" released by "delete_volume" :: held 3.295s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:47:33 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-570bb442-5fb4-4f9e-b39b-3260a97839ed tempest-BackendsCapabilitiesAdminTestsJSON-2028127203 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5848770141602, 'free_capacity_gb': 1775.5848770141602, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82046) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 24 13:47:34 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-166aee80-da65-4b23-b604-8200042092c9 tempest-BackendsCapabilitiesAdminTestsJSON-2028127203 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5848770141602, 'free_capacity_gb': 1775.5848770141602, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82046) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 24 13:47:35 devstack cinder-volume[82046]: DEBUG dbcounter [-] [82046] Writing DB stats cinder:SELECT=101,cinder:UPDATE=142,cinder:INSERT=26,cinder:DELETE=5 {{(pid=82046) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 13:47:35 devstack cinder-volume[82046]: DEBUG dbcounter [-] [82046] Writing DB stats cinder:SELECT=98,cinder:INSERT=26,cinder:UPDATE=93,cinder:DELETE=5 {{(pid=82046) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 13:47:37 devstack cinder-volume[82046]: DEBUG oslo_service.periodic_task [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82046) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 13:47:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:47:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:47:37 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:47:37 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:47:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:47:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:47:37 devstack sudo[85385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:47:37 devstack sudo[85385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:47:39 devstack sudo[85385]: pam_unix(sudo:session): session closed for user root Apr 24 13:47:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 1.439s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:47:39 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:47:45 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-c4ddc826-24ba-43ee-884c-ed24c541890d tempest-GroupSnapshotsV319Test-1898467817 None] Group tempest-GroupSnapshotsV319Test-Group-315426730: creating Apr 24 13:47:45 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-c4ddc826-24ba-43ee-884c-ed24c541890d tempest-GroupSnapshotsV319Test-1898467817 None] Group tempest-GroupSnapshotsV319Test-Group-315426730: created successfully Apr 24 13:47:45 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-c4ddc826-24ba-43ee-884c-ed24c541890d tempest-GroupSnapshotsV319Test-1898467817 None] Create group completed successfully. Apr 24 13:47:45 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-a07cc2f8-e14c-4535-bf6a-105b72d23857 tempest-VolumesServicesTestJSON-611369003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:47:45 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a07cc2f8-e14c-4535-bf6a-105b72d23857 tempest-VolumesServicesTestJSON-611369003 None] Flow 'volume_create_manager' (fa256d72-6783-455d-b4f7-df805a089568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:47:45 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a07cc2f8-e14c-4535-bf6a-105b72d23857 tempest-VolumesServicesTestJSON-611369003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00ee87fc-9c22-4288-a692-fb88578f85e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:47:45 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a07cc2f8-e14c-4535-bf6a-105b72d23857 tempest-VolumesServicesTestJSON-611369003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00ee87fc-9c22-4288-a692-fb88578f85e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:47:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-331103410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77e1f66f-bf92-4eff-bff0-a14695a43022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2d13c074e2b42d899370fd7493baa89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:47:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:47:46Z,use_quota=True,user_id='1145ab3e88c14e9fa68a66750fb76c70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:47:45 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a07cc2f8-e14c-4535-bf6a-105b72d23857 tempest-VolumesServicesTestJSON-611369003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd4fad91-c6ac-410c-85d0-374faed35632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:47:45 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a07cc2f8-e14c-4535-bf6a-105b72d23857 tempest-VolumesServicesTestJSON-611369003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd4fad91-c6ac-410c-85d0-374faed35632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:47:45 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a07cc2f8-e14c-4535-bf6a-105b72d23857 tempest-VolumesServicesTestJSON-611369003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7035b190-502d-4c8a-b2de-06b28c23178d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:47:45 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a07cc2f8-e14c-4535-bf6a-105b72d23857 tempest-VolumesServicesTestJSON-611369003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7035b190-502d-4c8a-b2de-06b28c23178d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77e1f66f-bf92-4eff-bff0-a14695a43022', 'volume_name': 'volume-77e1f66f-bf92-4eff-bff0-a14695a43022', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:47:45 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a07cc2f8-e14c-4535-bf6a-105b72d23857 tempest-VolumesServicesTestJSON-611369003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37b19813-2fd9-49d3-86a2-e41fccb774c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:47:45 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a07cc2f8-e14c-4535-bf6a-105b72d23857 tempest-VolumesServicesTestJSON-611369003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37b19813-2fd9-49d3-86a2-e41fccb774c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:47:45 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a07cc2f8-e14c-4535-bf6a-105b72d23857 tempest-VolumesServicesTestJSON-611369003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fdd56fe-06c2-45c8-b0ad-211723661397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:47:45 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-a07cc2f8-e14c-4535-bf6a-105b72d23857 tempest-VolumesServicesTestJSON-611369003 None] Volume 77e1f66f-bf92-4eff-bff0-a14695a43022: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77e1f66f-bf92-4eff-bff0-a14695a43022', 'volume_size': 1} Apr 24 13:47:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a07cc2f8-e14c-4535-bf6a-105b72d23857 tempest-VolumesServicesTestJSON-611369003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:47:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a07cc2f8-e14c-4535-bf6a-105b72d23857 tempest-VolumesServicesTestJSON-611369003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:47:45 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a07cc2f8-e14c-4535-bf6a-105b72d23857 tempest-VolumesServicesTestJSON-611369003 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:47:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-331103410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77e1f66f-bf92-4eff-bff0-a14695a43022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2d13c074e2b42d899370fd7493baa89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:47:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:47:46Z,use_quota=True,user_id='1145ab3e88c14e9fa68a66750fb76c70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:47:45 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-a07cc2f8-e14c-4535-bf6a-105b72d23857 tempest-VolumesServicesTestJSON-611369003 None] Creating volume 77e1f66f-bf92-4eff-bff0-a14695a43022 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:47:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a07cc2f8-e14c-4535-bf6a-105b72d23857 tempest-VolumesServicesTestJSON-611369003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:47:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a07cc2f8-e14c-4535-bf6a-105b72d23857 tempest-VolumesServicesTestJSON-611369003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:47:45 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a07cc2f8-e14c-4535-bf6a-105b72d23857 tempest-VolumesServicesTestJSON-611369003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:47:45 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a07cc2f8-e14c-4535-bf6a-105b72d23857 tempest-VolumesServicesTestJSON-611369003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:47:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a07cc2f8-e14c-4535-bf6a-105b72d23857 tempest-VolumesServicesTestJSON-611369003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:47:45 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a07cc2f8-e14c-4535-bf6a-105b72d23857 tempest-VolumesServicesTestJSON-611369003 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:47:45 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-a07cc2f8-e14c-4535-bf6a-105b72d23857 tempest-VolumesServicesTestJSON-611369003 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:47:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a07cc2f8-e14c-4535-bf6a-105b72d23857 tempest-VolumesServicesTestJSON-611369003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-77e1f66f-bf92-4eff-bff0-a14695a43022 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:47:46 devstack sudo[85441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-77e1f66f-bf92-4eff-bff0-a14695a43022 1073741824 Apr 24 13:47:46 devstack sudo[85441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:47:47 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f45e13b-ecfe-4662-8989-39f8329abec7 tempest-GroupSnapshotsV319Test-1898467817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:47:47 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4f45e13b-ecfe-4662-8989-39f8329abec7 tempest-GroupSnapshotsV319Test-1898467817 None] Flow 'volume_create_manager' (13438c0c-0a95-45aa-8779-48d2fe04761d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:47:47 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4f45e13b-ecfe-4662-8989-39f8329abec7 tempest-GroupSnapshotsV319Test-1898467817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2541640-908e-4782-86e1-d77adcc3a6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:47:47 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4f45e13b-ecfe-4662-8989-39f8329abec7 tempest-GroupSnapshotsV319Test-1898467817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2541640-908e-4782-86e1-d77adcc3a6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1804321768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=543a70cf-3dc4-4347-8d30-8dbb3fc8e1d9,host='devstack@QuobyteHD#QuobyteHD',id=cd704f5a-b228-4196-99d0-2561d87b4380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5aee673c2a24e519faf5e31b598ce08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:47:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:47:47Z,use_quota=True,user_id='18eb78f0568140ffbac1c31df23e86ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(36026d3d-61c3-4229-84fd-ab4adbc469fa),volume_type_id=36026d3d-61c3-4229-84fd-ab4adbc469fa)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:47:47 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4f45e13b-ecfe-4662-8989-39f8329abec7 tempest-GroupSnapshotsV319Test-1898467817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2674f8ed-c535-414d-904d-3e581fbc71bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:47:47 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4f45e13b-ecfe-4662-8989-39f8329abec7 tempest-GroupSnapshotsV319Test-1898467817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2674f8ed-c535-414d-904d-3e581fbc71bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:47:47 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4f45e13b-ecfe-4662-8989-39f8329abec7 tempest-GroupSnapshotsV319Test-1898467817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9828a13e-c5af-48d0-9d38-f297d36a8b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:47:47 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4f45e13b-ecfe-4662-8989-39f8329abec7 tempest-GroupSnapshotsV319Test-1898467817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9828a13e-c5af-48d0-9d38-f297d36a8b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd704f5a-b228-4196-99d0-2561d87b4380', 'volume_name': 'volume-cd704f5a-b228-4196-99d0-2561d87b4380', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:47:47 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4f45e13b-ecfe-4662-8989-39f8329abec7 tempest-GroupSnapshotsV319Test-1898467817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (614beeea-f333-4b6d-b1e3-26479aad3158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:47:47 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4f45e13b-ecfe-4662-8989-39f8329abec7 tempest-GroupSnapshotsV319Test-1898467817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (614beeea-f333-4b6d-b1e3-26479aad3158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:47:47 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4f45e13b-ecfe-4662-8989-39f8329abec7 tempest-GroupSnapshotsV319Test-1898467817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (783a7304-6997-4e50-a8f5-1c173ae8206f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:47:47 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-4f45e13b-ecfe-4662-8989-39f8329abec7 tempest-GroupSnapshotsV319Test-1898467817 None] Volume cd704f5a-b228-4196-99d0-2561d87b4380: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd704f5a-b228-4196-99d0-2561d87b4380', 'volume_size': 1} Apr 24 13:47:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4f45e13b-ecfe-4662-8989-39f8329abec7 tempest-GroupSnapshotsV319Test-1898467817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:47:47 devstack sudo[85441]: pam_unix(sudo:session): session closed for user root Apr 24 13:47:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a07cc2f8-e14c-4535-bf6a-105b72d23857 tempest-VolumesServicesTestJSON-611369003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-77e1f66f-bf92-4eff-bff0-a14695a43022 1073741824" returned: 0 in 1.316s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:47:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a07cc2f8-e14c-4535-bf6a-105b72d23857 tempest-VolumesServicesTestJSON-611369003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-77e1f66f-bf92-4eff-bff0-a14695a43022 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:47:47 devstack sudo[85448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-77e1f66f-bf92-4eff-bff0-a14695a43022 Apr 24 13:47:47 devstack sudo[85448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:47:48 devstack sudo[85448]: pam_unix(sudo:session): session closed for user root Apr 24 13:47:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a07cc2f8-e14c-4535-bf6a-105b72d23857 tempest-VolumesServicesTestJSON-611369003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-77e1f66f-bf92-4eff-bff0-a14695a43022" returned: 0 in 0.887s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:47:48 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a07cc2f8-e14c-4535-bf6a-105b72d23857 tempest-VolumesServicesTestJSON-611369003 None] <== create_volume: return (2276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:47:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a07cc2f8-e14c-4535-bf6a-105b72d23857 tempest-VolumesServicesTestJSON-611369003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.279s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:47:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4f45e13b-ecfe-4662-8989-39f8329abec7 tempest-GroupSnapshotsV319Test-1898467817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.070s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:47:48 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-4f45e13b-ecfe-4662-8989-39f8329abec7 tempest-GroupSnapshotsV319Test-1898467817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=543a70cf-3dc4-4347-8d30-8dbb3fc8e1d9,created_at=2026-04-24T11:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1804321768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=543a70cf-3dc4-4347-8d30-8dbb3fc8e1d9,host='devstack@QuobyteHD#QuobyteHD',id=cd704f5a-b228-4196-99d0-2561d87b4380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5aee673c2a24e519faf5e31b598ce08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:47:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:47:47Z,use_quota=True,user_id='18eb78f0568140ffbac1c31df23e86ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(36026d3d-61c3-4229-84fd-ab4adbc469fa),volume_type_id=36026d3d-61c3-4229-84fd-ab4adbc469fa)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:47:48 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-4f45e13b-ecfe-4662-8989-39f8329abec7 tempest-GroupSnapshotsV319Test-1898467817 None] Creating volume cd704f5a-b228-4196-99d0-2561d87b4380 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:47:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4f45e13b-ecfe-4662-8989-39f8329abec7 tempest-GroupSnapshotsV319Test-1898467817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:47:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4f45e13b-ecfe-4662-8989-39f8329abec7 tempest-GroupSnapshotsV319Test-1898467817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:47:48 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-4f45e13b-ecfe-4662-8989-39f8329abec7 tempest-GroupSnapshotsV319Test-1898467817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:47:48 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-4f45e13b-ecfe-4662-8989-39f8329abec7 tempest-GroupSnapshotsV319Test-1898467817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:47:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4f45e13b-ecfe-4662-8989-39f8329abec7 tempest-GroupSnapshotsV319Test-1898467817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:47:48 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-4f45e13b-ecfe-4662-8989-39f8329abec7 tempest-GroupSnapshotsV319Test-1898467817 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:47:48 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-4f45e13b-ecfe-4662-8989-39f8329abec7 tempest-GroupSnapshotsV319Test-1898467817 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:47:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4f45e13b-ecfe-4662-8989-39f8329abec7 tempest-GroupSnapshotsV319Test-1898467817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cd704f5a-b228-4196-99d0-2561d87b4380 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:47:48 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a07cc2f8-e14c-4535-bf6a-105b72d23857 tempest-VolumesServicesTestJSON-611369003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fdd56fe-06c2-45c8-b0ad-211723661397) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77e1f66f-bf92-4eff-bff0-a14695a43022', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:47:48 devstack sudo[85451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cd704f5a-b228-4196-99d0-2561d87b4380 1073741824 Apr 24 13:47:48 devstack sudo[85451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:47:48 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a07cc2f8-e14c-4535-bf6a-105b72d23857 tempest-VolumesServicesTestJSON-611369003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c604f08c-4e78-40da-a1dd-de5a2e9b0233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:47:48 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-a07cc2f8-e14c-4535-bf6a-105b72d23857 tempest-VolumesServicesTestJSON-611369003 None] Volume volume-77e1f66f-bf92-4eff-bff0-a14695a43022 (77e1f66f-bf92-4eff-bff0-a14695a43022): created successfully Apr 24 13:47:48 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a07cc2f8-e14c-4535-bf6a-105b72d23857 tempest-VolumesServicesTestJSON-611369003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c604f08c-4e78-40da-a1dd-de5a2e9b0233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:47:48 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a07cc2f8-e14c-4535-bf6a-105b72d23857 tempest-VolumesServicesTestJSON-611369003 None] Flow 'volume_create_manager' (fa256d72-6783-455d-b4f7-df805a089568) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:47:48 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-a07cc2f8-e14c-4535-bf6a-105b72d23857 tempest-VolumesServicesTestJSON-611369003 None] Created volume successfully. Apr 24 13:47:49 devstack sudo[85451]: pam_unix(sudo:session): session closed for user root Apr 24 13:47:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4f45e13b-ecfe-4662-8989-39f8329abec7 tempest-GroupSnapshotsV319Test-1898467817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cd704f5a-b228-4196-99d0-2561d87b4380 1073741824" returned: 0 in 0.952s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:47:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4f45e13b-ecfe-4662-8989-39f8329abec7 tempest-GroupSnapshotsV319Test-1898467817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cd704f5a-b228-4196-99d0-2561d87b4380 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:47:49 devstack sudo[85462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cd704f5a-b228-4196-99d0-2561d87b4380 Apr 24 13:47:49 devstack sudo[85462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:47:49 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-2b7432b7-6677-43d2-ba7b-5f8de7e8a979 tempest-VolumesServicesTestJSON-611369003 None] Acquiring lock "cinder-77e1f66f-bf92-4eff-bff0-a14695a43022-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:47:49 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-2b7432b7-6677-43d2-ba7b-5f8de7e8a979 tempest-VolumesServicesTestJSON-611369003 None] Lock "cinder-77e1f66f-bf92-4eff-bff0-a14695a43022-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:47:49 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-2b7432b7-6677-43d2-ba7b-5f8de7e8a979 tempest-VolumesServicesTestJSON-611369003 None] Acquiring lock "cinder-quobyte-77e1f66f-bf92-4eff-bff0-a14695a43022" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:47:49 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-2b7432b7-6677-43d2-ba7b-5f8de7e8a979 tempest-VolumesServicesTestJSON-611369003 None] Lock "cinder-quobyte-77e1f66f-bf92-4eff-bff0-a14695a43022" acquired by "delete_volume" :: waited 0.024s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:47:49 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35fca2c-4277-4fb8-80e6-e147d90d90c8]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:47:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2b7432b7-6677-43d2-ba7b-5f8de7e8a979 tempest-VolumesServicesTestJSON-611369003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-77e1f66f-bf92-4eff-bff0-a14695a43022 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:47:49 devstack sudo[85483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-77e1f66f-bf92-4eff-bff0-a14695a43022 Apr 24 13:47:49 devstack sudo[85483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:47:50 devstack sudo[85462]: pam_unix(sudo:session): session closed for user root Apr 24 13:47:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4f45e13b-ecfe-4662-8989-39f8329abec7 tempest-GroupSnapshotsV319Test-1898467817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cd704f5a-b228-4196-99d0-2561d87b4380" returned: 0 in 0.975s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:47:50 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-4f45e13b-ecfe-4662-8989-39f8329abec7 tempest-GroupSnapshotsV319Test-1898467817 None] <== create_volume: return (2012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:47:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4f45e13b-ecfe-4662-8989-39f8329abec7 tempest-GroupSnapshotsV319Test-1898467817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.029s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:47:50 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4f45e13b-ecfe-4662-8989-39f8329abec7 tempest-GroupSnapshotsV319Test-1898467817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (783a7304-6997-4e50-a8f5-1c173ae8206f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd704f5a-b228-4196-99d0-2561d87b4380', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:47:50 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4f45e13b-ecfe-4662-8989-39f8329abec7 tempest-GroupSnapshotsV319Test-1898467817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9284491f-cc53-4087-b04c-650079f6756f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:47:50 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-4f45e13b-ecfe-4662-8989-39f8329abec7 tempest-GroupSnapshotsV319Test-1898467817 None] Volume volume-cd704f5a-b228-4196-99d0-2561d87b4380 (cd704f5a-b228-4196-99d0-2561d87b4380): created successfully Apr 24 13:47:50 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4f45e13b-ecfe-4662-8989-39f8329abec7 tempest-GroupSnapshotsV319Test-1898467817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9284491f-cc53-4087-b04c-650079f6756f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:47:50 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4f45e13b-ecfe-4662-8989-39f8329abec7 tempest-GroupSnapshotsV319Test-1898467817 None] Flow 'volume_create_manager' (13438c0c-0a95-45aa-8779-48d2fe04761d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:47:50 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-4f45e13b-ecfe-4662-8989-39f8329abec7 tempest-GroupSnapshotsV319Test-1898467817 None] Created volume successfully. Apr 24 13:47:50 devstack sudo[85483]: pam_unix(sudo:session): session closed for user root Apr 24 13:47:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2b7432b7-6677-43d2-ba7b-5f8de7e8a979 tempest-VolumesServicesTestJSON-611369003 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-77e1f66f-bf92-4eff-bff0-a14695a43022" returned: 0 in 0.908s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:47:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2b7432b7-6677-43d2-ba7b-5f8de7e8a979 tempest-VolumesServicesTestJSON-611369003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-77e1f66f-bf92-4eff-bff0-a14695a43022 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:47:50 devstack sudo[85499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-77e1f66f-bf92-4eff-bff0-a14695a43022 Apr 24 13:47:50 devstack sudo[85499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:47:51 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-f9f0c18b-e9df-431b-9960-66ee4427bbe1 tempest-GroupSnapshotsV319Test-1898467817 None] GroupSnapshot ed60396e-9885-40df-889e-e0c4c7f75d94: creating. Apr 24 13:47:51 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f9f0c18b-e9df-431b-9960-66ee4427bbe1 tempest-GroupSnapshotsV319Test-1898467817 None] Group snapshot ed60396e-9885-40df-889e-e0c4c7f75d94: creating. {{(pid=82046) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 24 13:47:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f9f0c18b-e9df-431b-9960-66ee4427bbe1 tempest-GroupSnapshotsV319Test-1898467817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:47:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f9f0c18b-e9df-431b-9960-66ee4427bbe1 tempest-GroupSnapshotsV319Test-1898467817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:47:51 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-f9f0c18b-e9df-431b-9960-66ee4427bbe1 tempest-GroupSnapshotsV319Test-1898467817 None] Creating offline snapshot 9249dcd8-15ac-48c8-93dd-1def1660cb2b of volume cd704f5a-b228-4196-99d0-2561d87b4380 {{(pid=82046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 13:47:51 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f80ae8f-995d-45e6-a4d8-a5d261415d52]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:47:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f9f0c18b-e9df-431b-9960-66ee4427bbe1 tempest-GroupSnapshotsV319Test-1898467817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cd704f5a-b228-4196-99d0-2561d87b4380 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:47:51 devstack sudo[85502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cd704f5a-b228-4196-99d0-2561d87b4380 Apr 24 13:47:51 devstack sudo[85502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:47:51 devstack sudo[85499]: pam_unix(sudo:session): session closed for user root Apr 24 13:47:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2b7432b7-6677-43d2-ba7b-5f8de7e8a979 tempest-VolumesServicesTestJSON-611369003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-77e1f66f-bf92-4eff-bff0-a14695a43022" returned: 0 in 0.851s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:47:51 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-2b7432b7-6677-43d2-ba7b-5f8de7e8a979 tempest-VolumesServicesTestJSON-611369003 None] Lock "cinder-quobyte-77e1f66f-bf92-4eff-bff0-a14695a43022" released by "delete_volume" :: held 1.813s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:47:51 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-2b7432b7-6677-43d2-ba7b-5f8de7e8a979 tempest-VolumesServicesTestJSON-611369003 None] Created reservations ['c2238e9a-7f63-48b4-b23c-d8b17763f0e4', 'e549ce76-52d2-4e4b-b598-6f0f80d32359', 'dea8fc87-6052-45f5-8f9d-046d8b8e3df7', 'a315c834-6216-43d8-851b-49f74da265d0'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:47:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-2b7432b7-6677-43d2-ba7b-5f8de7e8a979 tempest-VolumesServicesTestJSON-611369003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:47:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-2b7432b7-6677-43d2-ba7b-5f8de7e8a979 tempest-VolumesServicesTestJSON-611369003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:47:51 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-2b7432b7-6677-43d2-ba7b-5f8de7e8a979 tempest-VolumesServicesTestJSON-611369003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:47:51 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-2b7432b7-6677-43d2-ba7b-5f8de7e8a979 tempest-VolumesServicesTestJSON-611369003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:47:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-2b7432b7-6677-43d2-ba7b-5f8de7e8a979 tempest-VolumesServicesTestJSON-611369003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:47:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2b7432b7-6677-43d2-ba7b-5f8de7e8a979 tempest-VolumesServicesTestJSON-611369003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:47:51 devstack sudo[85506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:47:51 devstack sudo[85506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:47:52 devstack sudo[85502]: pam_unix(sudo:session): session closed for user root Apr 24 13:47:52 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f9f0c18b-e9df-431b-9960-66ee4427bbe1 tempest-GroupSnapshotsV319Test-1898467817 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cd704f5a-b228-4196-99d0-2561d87b4380" returned: 0 in 1.058s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:47:52 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f9f0c18b-e9df-431b-9960-66ee4427bbe1 tempest-GroupSnapshotsV319Test-1898467817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cd704f5a-b228-4196-99d0-2561d87b4380,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cd704f5a-b228-4196-99d0-2561d87b4380.9249dcd8-15ac-48c8-93dd-1def1660cb2b 1G {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:47:52 devstack sudo[85533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cd704f5a-b228-4196-99d0-2561d87b4380,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cd704f5a-b228-4196-99d0-2561d87b4380.9249dcd8-15ac-48c8-93dd-1def1660cb2b 1G Apr 24 13:47:52 devstack sudo[85533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:47:53 devstack sudo[85506]: pam_unix(sudo:session): session closed for user root Apr 24 13:47:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2b7432b7-6677-43d2-ba7b-5f8de7e8a979 tempest-VolumesServicesTestJSON-611369003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 1.217s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:47:53 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-2b7432b7-6677-43d2-ba7b-5f8de7e8a979 tempest-VolumesServicesTestJSON-611369003 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:47:53 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-2b7432b7-6677-43d2-ba7b-5f8de7e8a979 tempest-VolumesServicesTestJSON-611369003 None] Deleted volume successfully. Apr 24 13:47:53 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-2b7432b7-6677-43d2-ba7b-5f8de7e8a979 tempest-VolumesServicesTestJSON-611369003 None] Lock "cinder-77e1f66f-bf92-4eff-bff0-a14695a43022-delete_volume" released by "delete_volume" :: held 3.383s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:47:53 devstack sudo[85533]: pam_unix(sudo:session): session closed for user root Apr 24 13:47:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f9f0c18b-e9df-431b-9960-66ee4427bbe1 tempest-GroupSnapshotsV319Test-1898467817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cd704f5a-b228-4196-99d0-2561d87b4380,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cd704f5a-b228-4196-99d0-2561d87b4380.9249dcd8-15ac-48c8-93dd-1def1660cb2b 1G" returned: 0 in 1.073s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:47:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f9f0c18b-e9df-431b-9960-66ee4427bbe1 tempest-GroupSnapshotsV319Test-1898467817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd704f5a-b228-4196-99d0-2561d87b4380 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cd704f5a-b228-4196-99d0-2561d87b4380.9249dcd8-15ac-48c8-93dd-1def1660cb2b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:47:53 devstack sudo[85577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd704f5a-b228-4196-99d0-2561d87b4380 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cd704f5a-b228-4196-99d0-2561d87b4380.9249dcd8-15ac-48c8-93dd-1def1660cb2b Apr 24 13:47:53 devstack sudo[85577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:47:54 devstack sudo[85577]: pam_unix(sudo:session): session closed for user root Apr 24 13:47:54 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f9f0c18b-e9df-431b-9960-66ee4427bbe1 tempest-GroupSnapshotsV319Test-1898467817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd704f5a-b228-4196-99d0-2561d87b4380 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cd704f5a-b228-4196-99d0-2561d87b4380.9249dcd8-15ac-48c8-93dd-1def1660cb2b" returned: 0 in 0.756s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:47:54 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-f9f0c18b-e9df-431b-9960-66ee4427bbe1 tempest-GroupSnapshotsV319Test-1898467817 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cd704f5a-b228-4196-99d0-2561d87b4380.9249dcd8-15ac-48c8-93dd-1def1660cb2b is being set with open permissions: ugo+rw: NotImplementedError Apr 24 13:47:54 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f9f0c18b-e9df-431b-9960-66ee4427bbe1 tempest-GroupSnapshotsV319Test-1898467817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cd704f5a-b228-4196-99d0-2561d87b4380.9249dcd8-15ac-48c8-93dd-1def1660cb2b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:47:54 devstack sudo[85582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cd704f5a-b228-4196-99d0-2561d87b4380.9249dcd8-15ac-48c8-93dd-1def1660cb2b Apr 24 13:47:54 devstack sudo[85582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:47:54 devstack sudo[85582]: pam_unix(sudo:session): session closed for user root Apr 24 13:47:54 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f9f0c18b-e9df-431b-9960-66ee4427bbe1 tempest-GroupSnapshotsV319Test-1898467817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cd704f5a-b228-4196-99d0-2561d87b4380.9249dcd8-15ac-48c8-93dd-1def1660cb2b" returned: 0 in 0.649s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:47:54 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f9f0c18b-e9df-431b-9960-66ee4427bbe1 tempest-GroupSnapshotsV319Test-1898467817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cd704f5a-b228-4196-99d0-2561d87b4380.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:47:54 devstack sudo[85586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cd704f5a-b228-4196-99d0-2561d87b4380.info Apr 24 13:47:54 devstack sudo[85586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:47:55 devstack sudo[85586]: pam_unix(sudo:session): session closed for user root Apr 24 13:47:55 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f9f0c18b-e9df-431b-9960-66ee4427bbe1 tempest-GroupSnapshotsV319Test-1898467817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cd704f5a-b228-4196-99d0-2561d87b4380.info" returned: 0 in 0.777s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:47:55 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-f9f0c18b-e9df-431b-9960-66ee4427bbe1 tempest-GroupSnapshotsV319Test-1898467817 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cd704f5a-b228-4196-99d0-2561d87b4380.info is being set with open permissions: ugo+rw: NotImplementedError Apr 24 13:47:55 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f9f0c18b-e9df-431b-9960-66ee4427bbe1 tempest-GroupSnapshotsV319Test-1898467817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cd704f5a-b228-4196-99d0-2561d87b4380.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:47:55 devstack sudo[85590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cd704f5a-b228-4196-99d0-2561d87b4380.info Apr 24 13:47:55 devstack sudo[85590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:47:56 devstack sudo[85590]: pam_unix(sudo:session): session closed for user root Apr 24 13:47:56 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f9f0c18b-e9df-431b-9960-66ee4427bbe1 tempest-GroupSnapshotsV319Test-1898467817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cd704f5a-b228-4196-99d0-2561d87b4380.info" returned: 0 in 0.626s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:47:56 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f9f0c18b-e9df-431b-9960-66ee4427bbe1 tempest-GroupSnapshotsV319Test-1898467817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.075s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:47:56 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-f9f0c18b-e9df-431b-9960-66ee4427bbe1 tempest-GroupSnapshotsV319Test-1898467817 None] group_snapshot ed60396e-9885-40df-889e-e0c4c7f75d94: created successfully Apr 24 13:47:56 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-cbc2ad55-e87c-46a4-8a7d-f81fb6b25bc7 tempest-GroupSnapshotsV319Test-1898467817 None] group_snapshot ed60396e-9885-40df-889e-e0c4c7f75d94: deleting Apr 24 13:47:56 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-cbc2ad55-e87c-46a4-8a7d-f81fb6b25bc7 tempest-GroupSnapshotsV319Test-1898467817 None] group_snapshot ed60396e-9885-40df-889e-e0c4c7f75d94: deleting {{(pid=82046) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 24 13:47:56 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-cbc2ad55-e87c-46a4-8a7d-f81fb6b25bc7 tempest-GroupSnapshotsV319Test-1898467817 None] Acquiring lock "cinder-quobyte-cd704f5a-b228-4196-99d0-2561d87b4380" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:47:57 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-cbc2ad55-e87c-46a4-8a7d-f81fb6b25bc7 tempest-GroupSnapshotsV319Test-1898467817 None] Lock "cinder-quobyte-cd704f5a-b228-4196-99d0-2561d87b4380" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:47:57 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-cbc2ad55-e87c-46a4-8a7d-f81fb6b25bc7 tempest-GroupSnapshotsV319Test-1898467817 None] Acquiring lock "cinder-quobyte-9249dcd8-15ac-48c8-93dd-1def1660cb2b" by "_delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:47:57 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-cbc2ad55-e87c-46a4-8a7d-f81fb6b25bc7 tempest-GroupSnapshotsV319Test-1898467817 None] Lock "cinder-quobyte-9249dcd8-15ac-48c8-93dd-1def1660cb2b" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:47:57 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-cbc2ad55-e87c-46a4-8a7d-f81fb6b25bc7 tempest-GroupSnapshotsV319Test-1898467817 None] Deleting offline snapshot 9249dcd8-15ac-48c8-93dd-1def1660cb2b of volume cd704f5a-b228-4196-99d0-2561d87b4380 {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 13:47:57 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-cbc2ad55-e87c-46a4-8a7d-f81fb6b25bc7 tempest-GroupSnapshotsV319Test-1898467817 None] snapshot_file for this snap is: volume-cd704f5a-b228-4196-99d0-2561d87b4380.9249dcd8-15ac-48c8-93dd-1def1660cb2b {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 13:47:57 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[274c5864-acc1-441f-a770-9ccd3b0da134]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:47:57 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-cbc2ad55-e87c-46a4-8a7d-f81fb6b25bc7 tempest-GroupSnapshotsV319Test-1898467817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cd704f5a-b228-4196-99d0-2561d87b4380.9249dcd8-15ac-48c8-93dd-1def1660cb2b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:47:57 devstack sudo[85593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cd704f5a-b228-4196-99d0-2561d87b4380.9249dcd8-15ac-48c8-93dd-1def1660cb2b Apr 24 13:47:57 devstack sudo[85593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:47:57 devstack sudo[85593]: pam_unix(sudo:session): session closed for user root Apr 24 13:47:57 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-cbc2ad55-e87c-46a4-8a7d-f81fb6b25bc7 tempest-GroupSnapshotsV319Test-1898467817 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cd704f5a-b228-4196-99d0-2561d87b4380.9249dcd8-15ac-48c8-93dd-1def1660cb2b" returned: 0 in 0.836s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:47:57 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-cbc2ad55-e87c-46a4-8a7d-f81fb6b25bc7 tempest-GroupSnapshotsV319Test-1898467817 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd704f5a-b228-4196-99d0-2561d87b4380(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:47:58 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[8007957c-519a-4c55-b62b-57c43115d0d5]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:47:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-cbc2ad55-e87c-46a4-8a7d-f81fb6b25bc7 tempest-GroupSnapshotsV319Test-1898467817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cd704f5a-b228-4196-99d0-2561d87b4380 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:47:58 devstack sudo[85601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cd704f5a-b228-4196-99d0-2561d87b4380 Apr 24 13:47:58 devstack sudo[85601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:47:58 devstack sudo[85601]: pam_unix(sudo:session): session closed for user root Apr 24 13:47:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-cbc2ad55-e87c-46a4-8a7d-f81fb6b25bc7 tempest-GroupSnapshotsV319Test-1898467817 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cd704f5a-b228-4196-99d0-2561d87b4380" returned: 0 in 0.824s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:47:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-cbc2ad55-e87c-46a4-8a7d-f81fb6b25bc7 tempest-GroupSnapshotsV319Test-1898467817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cd704f5a-b228-4196-99d0-2561d87b4380.9249dcd8-15ac-48c8-93dd-1def1660cb2b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:47:58 devstack sudo[85609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cd704f5a-b228-4196-99d0-2561d87b4380.9249dcd8-15ac-48c8-93dd-1def1660cb2b Apr 24 13:47:58 devstack sudo[85609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:47:59 devstack sudo[85609]: pam_unix(sudo:session): session closed for user root Apr 24 13:47:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-cbc2ad55-e87c-46a4-8a7d-f81fb6b25bc7 tempest-GroupSnapshotsV319Test-1898467817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cd704f5a-b228-4196-99d0-2561d87b4380.9249dcd8-15ac-48c8-93dd-1def1660cb2b" returned: 0 in 0.853s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:47:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-cbc2ad55-e87c-46a4-8a7d-f81fb6b25bc7 tempest-GroupSnapshotsV319Test-1898467817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cd704f5a-b228-4196-99d0-2561d87b4380.9249dcd8-15ac-48c8-93dd-1def1660cb2b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:47:59 devstack sudo[85614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cd704f5a-b228-4196-99d0-2561d87b4380.9249dcd8-15ac-48c8-93dd-1def1660cb2b Apr 24 13:47:59 devstack sudo[85614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:00 devstack sudo[85614]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:00 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-cbc2ad55-e87c-46a4-8a7d-f81fb6b25bc7 tempest-GroupSnapshotsV319Test-1898467817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cd704f5a-b228-4196-99d0-2561d87b4380.9249dcd8-15ac-48c8-93dd-1def1660cb2b" returned: 0 in 0.632s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:00 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-cbc2ad55-e87c-46a4-8a7d-f81fb6b25bc7 tempest-GroupSnapshotsV319Test-1898467817 None] Lock "cinder-quobyte-9249dcd8-15ac-48c8-93dd-1def1660cb2b" released by "_delete_snapshot" :: held 3.366s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:48:00 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-cbc2ad55-e87c-46a4-8a7d-f81fb6b25bc7 tempest-GroupSnapshotsV319Test-1898467817 None] Lock "cinder-quobyte-cd704f5a-b228-4196-99d0-2561d87b4380" released by "delete_snapshot" :: held 3.428s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:48:00 devstack cinder-volume[82046]: WARNING cinder.quota [None req-cbc2ad55-e87c-46a4-8a7d-f81fb6b25bc7 tempest-GroupSnapshotsV319Test-1898467817 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2119744833 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2119744833, it is now deprecated. Please use the default quota class for default quota. Apr 24 13:48:00 devstack cinder-volume[82046]: WARNING cinder.quota [None req-cbc2ad55-e87c-46a4-8a7d-f81fb6b25bc7 tempest-GroupSnapshotsV319Test-1898467817 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2119744833 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2119744833, it is now deprecated. Please use the default quota class for default quota. Apr 24 13:48:00 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-cbc2ad55-e87c-46a4-8a7d-f81fb6b25bc7 tempest-GroupSnapshotsV319Test-1898467817 None] Created reservations ['68e29bd6-b1b1-4e73-8486-b18592aed481', 'e04162f7-df1f-4943-8ce2-dcce960105f4', 'bf7873b6-3a69-41d2-af16-09db6d8b7035', '58722025-4113-449b-9750-e6ba43394706'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:48:00 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-cbc2ad55-e87c-46a4-8a7d-f81fb6b25bc7 tempest-GroupSnapshotsV319Test-1898467817 None] group_snapshot ed60396e-9885-40df-889e-e0c4c7f75d94: deleted successfully Apr 24 13:48:01 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-50d0d4d8-fdd5-43a2-8fd4-bc1b9bf38d34 tempest-GroupSnapshotsV319Test-1898467817 None] Acquiring lock "cinder-quobyte-cd704f5a-b228-4196-99d0-2561d87b4380" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:48:01 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-50d0d4d8-fdd5-43a2-8fd4-bc1b9bf38d34 tempest-GroupSnapshotsV319Test-1898467817 None] Lock "cinder-quobyte-cd704f5a-b228-4196-99d0-2561d87b4380" acquired by "delete_volume" :: waited 0.017s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:48:01 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[122ce424-a390-4b25-9b87-aa6aad7bc96b]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:48:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-50d0d4d8-fdd5-43a2-8fd4-bc1b9bf38d34 tempest-GroupSnapshotsV319Test-1898467817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cd704f5a-b228-4196-99d0-2561d87b4380 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:01 devstack sudo[85617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cd704f5a-b228-4196-99d0-2561d87b4380 Apr 24 13:48:01 devstack sudo[85617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:02 devstack sudo[85617]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-50d0d4d8-fdd5-43a2-8fd4-bc1b9bf38d34 tempest-GroupSnapshotsV319Test-1898467817 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cd704f5a-b228-4196-99d0-2561d87b4380" returned: 0 in 0.933s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-50d0d4d8-fdd5-43a2-8fd4-bc1b9bf38d34 tempest-GroupSnapshotsV319Test-1898467817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cd704f5a-b228-4196-99d0-2561d87b4380 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:02 devstack sudo[85622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cd704f5a-b228-4196-99d0-2561d87b4380 Apr 24 13:48:02 devstack sudo[85622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:03 devstack sudo[85622]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-50d0d4d8-fdd5-43a2-8fd4-bc1b9bf38d34 tempest-GroupSnapshotsV319Test-1898467817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cd704f5a-b228-4196-99d0-2561d87b4380" returned: 0 in 0.771s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:03 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-50d0d4d8-fdd5-43a2-8fd4-bc1b9bf38d34 tempest-GroupSnapshotsV319Test-1898467817 None] Lock "cinder-quobyte-cd704f5a-b228-4196-99d0-2561d87b4380" released by "delete_volume" :: held 1.813s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:48:03 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-50d0d4d8-fdd5-43a2-8fd4-bc1b9bf38d34 tempest-GroupSnapshotsV319Test-1898467817 None] Created reservations ['48fca560-f97b-46df-b0ab-7084fec259b2'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:48:03 devstack cinder-volume[82046]: WARNING cinder.quota [None req-50d0d4d8-fdd5-43a2-8fd4-bc1b9bf38d34 tempest-GroupSnapshotsV319Test-1898467817 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2119744833 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2119744833, it is now deprecated. Please use the default quota class for default quota. Apr 24 13:48:03 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-50d0d4d8-fdd5-43a2-8fd4-bc1b9bf38d34 tempest-GroupSnapshotsV319Test-1898467817 None] Created reservations ['a4de368a-4654-4546-ae06-bef8a8367408', '1fbdd014-26b1-4929-8c5a-f1d369120f08', 'c4a8e80c-64ec-45ab-8643-e6af377d3da6', 'eddcb6c0-9c9b-4280-bd4e-d5692d909a72'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:48:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-50d0d4d8-fdd5-43a2-8fd4-bc1b9bf38d34 tempest-GroupSnapshotsV319Test-1898467817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:48:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-50d0d4d8-fdd5-43a2-8fd4-bc1b9bf38d34 tempest-GroupSnapshotsV319Test-1898467817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:48:03 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-50d0d4d8-fdd5-43a2-8fd4-bc1b9bf38d34 tempest-GroupSnapshotsV319Test-1898467817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:48:03 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-50d0d4d8-fdd5-43a2-8fd4-bc1b9bf38d34 tempest-GroupSnapshotsV319Test-1898467817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:48:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-50d0d4d8-fdd5-43a2-8fd4-bc1b9bf38d34 tempest-GroupSnapshotsV319Test-1898467817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:48:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-50d0d4d8-fdd5-43a2-8fd4-bc1b9bf38d34 tempest-GroupSnapshotsV319Test-1898467817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:04 devstack sudo[85625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:48:04 devstack sudo[85625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:04 devstack sudo[85625]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:04 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-50d0d4d8-fdd5-43a2-8fd4-bc1b9bf38d34 tempest-GroupSnapshotsV319Test-1898467817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.926s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:04 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-50d0d4d8-fdd5-43a2-8fd4-bc1b9bf38d34 tempest-GroupSnapshotsV319Test-1898467817 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:48:04 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-50d0d4d8-fdd5-43a2-8fd4-bc1b9bf38d34 tempest-GroupSnapshotsV319Test-1898467817 None] Delete group completed successfully. Apr 24 13:48:06 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa9d7e31-2e49-4ae5-b9a1-167494ad1f13 tempest-VolumesDeleteCascade-2142546263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:48:06 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-fa9d7e31-2e49-4ae5-b9a1-167494ad1f13 tempest-VolumesDeleteCascade-2142546263 None] Flow 'volume_create_manager' (1c3ab220-a1f3-40c3-a9ac-c3baca70199d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:48:06 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-fa9d7e31-2e49-4ae5-b9a1-167494ad1f13 tempest-VolumesDeleteCascade-2142546263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a3d9c88-c7aa-4175-80b9-6f824a36d2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:06 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-fa9d7e31-2e49-4ae5-b9a1-167494ad1f13 tempest-VolumesDeleteCascade-2142546263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a3d9c88-c7aa-4175-80b9-6f824a36d2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-857465283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8c1a971-0e28-43d9-a6e4-2741f60837e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f96a8076471449f4b83361e0131fc98b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:48:06Z,use_quota=True,user_id='b2c6b73e64fe4522899835af23694731',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:06 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-fa9d7e31-2e49-4ae5-b9a1-167494ad1f13 tempest-VolumesDeleteCascade-2142546263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3b8b019-4133-4c84-8e7d-5bf995664598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:06 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-fa9d7e31-2e49-4ae5-b9a1-167494ad1f13 tempest-VolumesDeleteCascade-2142546263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3b8b019-4133-4c84-8e7d-5bf995664598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:06 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-fa9d7e31-2e49-4ae5-b9a1-167494ad1f13 tempest-VolumesDeleteCascade-2142546263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5f151c7-5595-45fc-a8d1-ef604e37ef7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:06 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-fa9d7e31-2e49-4ae5-b9a1-167494ad1f13 tempest-VolumesDeleteCascade-2142546263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5f151c7-5595-45fc-a8d1-ef604e37ef7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8c1a971-0e28-43d9-a6e4-2741f60837e3', 'volume_name': 'volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:06 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-fa9d7e31-2e49-4ae5-b9a1-167494ad1f13 tempest-VolumesDeleteCascade-2142546263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a700a86-b1cd-4908-9cdf-16ffd0f636fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:06 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-fa9d7e31-2e49-4ae5-b9a1-167494ad1f13 tempest-VolumesDeleteCascade-2142546263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a700a86-b1cd-4908-9cdf-16ffd0f636fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:06 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-fa9d7e31-2e49-4ae5-b9a1-167494ad1f13 tempest-VolumesDeleteCascade-2142546263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e5c870c-26ba-4dd2-821c-11080ccddb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:06 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-fa9d7e31-2e49-4ae5-b9a1-167494ad1f13 tempest-VolumesDeleteCascade-2142546263 None] Volume a8c1a971-0e28-43d9-a6e4-2741f60837e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3', 'volume_size': 1} Apr 24 13:48:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-fa9d7e31-2e49-4ae5-b9a1-167494ad1f13 tempest-VolumesDeleteCascade-2142546263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:48:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-fa9d7e31-2e49-4ae5-b9a1-167494ad1f13 tempest-VolumesDeleteCascade-2142546263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:48:06 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-fa9d7e31-2e49-4ae5-b9a1-167494ad1f13 tempest-VolumesDeleteCascade-2142546263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-857465283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8c1a971-0e28-43d9-a6e4-2741f60837e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f96a8076471449f4b83361e0131fc98b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:48:06Z,use_quota=True,user_id='b2c6b73e64fe4522899835af23694731',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:48:06 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-fa9d7e31-2e49-4ae5-b9a1-167494ad1f13 tempest-VolumesDeleteCascade-2142546263 None] Creating volume a8c1a971-0e28-43d9-a6e4-2741f60837e3 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:48:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-fa9d7e31-2e49-4ae5-b9a1-167494ad1f13 tempest-VolumesDeleteCascade-2142546263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:48:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-fa9d7e31-2e49-4ae5-b9a1-167494ad1f13 tempest-VolumesDeleteCascade-2142546263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:48:06 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-fa9d7e31-2e49-4ae5-b9a1-167494ad1f13 tempest-VolumesDeleteCascade-2142546263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:48:06 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-fa9d7e31-2e49-4ae5-b9a1-167494ad1f13 tempest-VolumesDeleteCascade-2142546263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:48:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-fa9d7e31-2e49-4ae5-b9a1-167494ad1f13 tempest-VolumesDeleteCascade-2142546263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:48:06 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-fa9d7e31-2e49-4ae5-b9a1-167494ad1f13 tempest-VolumesDeleteCascade-2142546263 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:48:06 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-fa9d7e31-2e49-4ae5-b9a1-167494ad1f13 tempest-VolumesDeleteCascade-2142546263 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:48:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-fa9d7e31-2e49-4ae5-b9a1-167494ad1f13 tempest-VolumesDeleteCascade-2142546263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:06 devstack sudo[85631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3 1073741824 Apr 24 13:48:06 devstack sudo[85631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:06 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:48:06 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Flow 'volume_create_manager' (46bc4f1f-e6fb-4e01-b0ca-6fe3df12aac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:48:06 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (512a9da1-1f48-4718-ac18-ec20e6282830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:06 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (512a9da1-1f48-4718-ac18-ec20e6282830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:48:07Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5cbeb5d-8080-4519-a829-34efa5a0576d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fc671775a304cc789bb9beb3b8ba47b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:48:07Z,use_quota=True,user_id='52bc9aff0b104aa19ab83685ea6380f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:06 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (179daec6-ca1a-40cd-8849-2f408b956d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:06 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (179daec6-ca1a-40cd-8849-2f408b956d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:06 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6704b2ae-0f5b-4e0d-b0c5-8a6213fe0ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:06 devstack cinder-volume[82046]: DEBUG cinder.image.glance [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Creating Keystone auth plugin from conf {{(pid=82046) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 24 13:48:07 devstack sudo[85631]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-fa9d7e31-2e49-4ae5-b9a1-167494ad1f13 tempest-VolumesDeleteCascade-2142546263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3 1073741824" returned: 0 in 1.130s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-fa9d7e31-2e49-4ae5-b9a1-167494ad1f13 tempest-VolumesDeleteCascade-2142546263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:07 devstack sudo[85636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3 Apr 24 13:48:07 devstack sudo[85636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:07 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6704b2ae-0f5b-4e0d-b0c5-8a6213fe0ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f5cbeb5d-8080-4519-a829-34efa5a0576d', 'volume_name': 'volume-f5cbeb5d-8080-4519-a829-34efa5a0576d', 'volume_size': 1, 'image_id': '02b8aec0-dc1c-4b93-81c4-ab6b88d472d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02b8aec0-dc1c-4b93-81c4-ab6b88d472d9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db6d5b1c41254596bd8bad1e5f7bec28', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02b8aec0-dc1c-4b93-81c4-ab6b88d472d9', 'created_at': datetime.datetime(2026, 4, 24, 11, 39, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 11, 39, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02b8aec0-dc1c-4b93-81c4-ab6b88d472d9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:07 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a1c0e62-d9e1-4e71-810b-69dfdcabdd53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:07 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a1c0e62-d9e1-4e71-810b-69dfdcabdd53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:07 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8170bea3-0650-470a-b95d-bb87155d2011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:07 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Volume f5cbeb5d-8080-4519-a829-34efa5a0576d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f5cbeb5d-8080-4519-a829-34efa5a0576d', 'volume_size': 1, 'image_id': '02b8aec0-dc1c-4b93-81c4-ab6b88d472d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02b8aec0-dc1c-4b93-81c4-ab6b88d472d9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db6d5b1c41254596bd8bad1e5f7bec28', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02b8aec0-dc1c-4b93-81c4-ab6b88d472d9', 'created_at': datetime.datetime(2026, 4, 24, 11, 39, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 11, 39, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02b8aec0-dc1c-4b93-81c4-ab6b88d472d9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 24 13:48:07 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Trying to clone f5cbeb5d-8080-4519-a829-34efa5a0576d from image 02b8aec0-dc1c-4b93-81c4-ab6b88d472d9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/02b8aec0-dc1c-4b93-81c4-ab6b88d472d9', 'metadata': {}}]). {{(pid=82046) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 24 13:48:08 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cdadbec-89ed-407f-a1d4-a34387206e53 tempest-VolumesListAdminTestJSON-277972602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:48:08 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-7cdadbec-89ed-407f-a1d4-a34387206e53 tempest-VolumesListAdminTestJSON-277972602 None] Flow 'volume_create_manager' (321164d1-ff6f-41d1-b44c-e53a1b6a94ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:48:08 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-7cdadbec-89ed-407f-a1d4-a34387206e53 tempest-VolumesListAdminTestJSON-277972602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (292d3663-32c4-4981-b610-90fe88ccfb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:08 devstack sudo[85636]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:08 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-7cdadbec-89ed-407f-a1d4-a34387206e53 tempest-VolumesListAdminTestJSON-277972602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (292d3663-32c4-4981-b610-90fe88ccfb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1342949359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da74171e-1312-498c-b7e1-4fa32691f232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='184804f98a764331911aa81251c626a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:48:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:48:08Z,use_quota=True,user_id='99f61ba7295545a7a1abe1533ef8c1a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:08 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-7cdadbec-89ed-407f-a1d4-a34387206e53 tempest-VolumesListAdminTestJSON-277972602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53c175bd-b528-48eb-b5ac-6d734a0cdc6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:08 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-7cdadbec-89ed-407f-a1d4-a34387206e53 tempest-VolumesListAdminTestJSON-277972602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53c175bd-b528-48eb-b5ac-6d734a0cdc6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:08 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-7cdadbec-89ed-407f-a1d4-a34387206e53 tempest-VolumesListAdminTestJSON-277972602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c20e1f36-3fda-4866-8944-ef44040182fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:08 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-7cdadbec-89ed-407f-a1d4-a34387206e53 tempest-VolumesListAdminTestJSON-277972602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c20e1f36-3fda-4866-8944-ef44040182fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da74171e-1312-498c-b7e1-4fa32691f232', 'volume_name': 'volume-da74171e-1312-498c-b7e1-4fa32691f232', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:08 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-7cdadbec-89ed-407f-a1d4-a34387206e53 tempest-VolumesListAdminTestJSON-277972602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30c57113-2b98-4a75-9dd3-c292cf540438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:08 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-7cdadbec-89ed-407f-a1d4-a34387206e53 tempest-VolumesListAdminTestJSON-277972602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30c57113-2b98-4a75-9dd3-c292cf540438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:08 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-7cdadbec-89ed-407f-a1d4-a34387206e53 tempest-VolumesListAdminTestJSON-277972602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (058530af-b774-4f62-96b1-1026c01543ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:08 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-7cdadbec-89ed-407f-a1d4-a34387206e53 tempest-VolumesListAdminTestJSON-277972602 None] Volume da74171e-1312-498c-b7e1-4fa32691f232: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da74171e-1312-498c-b7e1-4fa32691f232', 'volume_size': 1} Apr 24 13:48:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-7cdadbec-89ed-407f-a1d4-a34387206e53 tempest-VolumesListAdminTestJSON-277972602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:48:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-fa9d7e31-2e49-4ae5-b9a1-167494ad1f13 tempest-VolumesDeleteCascade-2142546263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3" returned: 0 in 0.949s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:08 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-fa9d7e31-2e49-4ae5-b9a1-167494ad1f13 tempest-VolumesDeleteCascade-2142546263 None] <== create_volume: return (2122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:48:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-fa9d7e31-2e49-4ae5-b9a1-167494ad1f13 tempest-VolumesDeleteCascade-2142546263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.125s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:48:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-7cdadbec-89ed-407f-a1d4-a34387206e53 tempest-VolumesListAdminTestJSON-277972602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.018s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:48:08 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-7cdadbec-89ed-407f-a1d4-a34387206e53 tempest-VolumesListAdminTestJSON-277972602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1342949359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da74171e-1312-498c-b7e1-4fa32691f232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='184804f98a764331911aa81251c626a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:48:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:48:08Z,use_quota=True,user_id='99f61ba7295545a7a1abe1533ef8c1a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:48:08 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-7cdadbec-89ed-407f-a1d4-a34387206e53 tempest-VolumesListAdminTestJSON-277972602 None] Creating volume da74171e-1312-498c-b7e1-4fa32691f232 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:48:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-7cdadbec-89ed-407f-a1d4-a34387206e53 tempest-VolumesListAdminTestJSON-277972602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:48:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-7cdadbec-89ed-407f-a1d4-a34387206e53 tempest-VolumesListAdminTestJSON-277972602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:48:08 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-7cdadbec-89ed-407f-a1d4-a34387206e53 tempest-VolumesListAdminTestJSON-277972602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:48:08 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-7cdadbec-89ed-407f-a1d4-a34387206e53 tempest-VolumesListAdminTestJSON-277972602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:48:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-7cdadbec-89ed-407f-a1d4-a34387206e53 tempest-VolumesListAdminTestJSON-277972602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:48:08 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-7cdadbec-89ed-407f-a1d4-a34387206e53 tempest-VolumesListAdminTestJSON-277972602 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:48:08 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-7cdadbec-89ed-407f-a1d4-a34387206e53 tempest-VolumesListAdminTestJSON-277972602 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:48:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7cdadbec-89ed-407f-a1d4-a34387206e53 tempest-VolumesListAdminTestJSON-277972602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-da74171e-1312-498c-b7e1-4fa32691f232 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:08 devstack sudo[85660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-da74171e-1312-498c-b7e1-4fa32691f232 1073741824 Apr 24 13:48:08 devstack sudo[85660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:08 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-fa9d7e31-2e49-4ae5-b9a1-167494ad1f13 tempest-VolumesDeleteCascade-2142546263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e5c870c-26ba-4dd2-821c-11080ccddb7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:08 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-fa9d7e31-2e49-4ae5-b9a1-167494ad1f13 tempest-VolumesDeleteCascade-2142546263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56df15a2-2137-42a7-b175-554f0c642db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:08 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-fa9d7e31-2e49-4ae5-b9a1-167494ad1f13 tempest-VolumesDeleteCascade-2142546263 None] Volume volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3 (a8c1a971-0e28-43d9-a6e4-2741f60837e3): created successfully Apr 24 13:48:08 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-fa9d7e31-2e49-4ae5-b9a1-167494ad1f13 tempest-VolumesDeleteCascade-2142546263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56df15a2-2137-42a7-b175-554f0c642db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:08 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-fa9d7e31-2e49-4ae5-b9a1-167494ad1f13 tempest-VolumesDeleteCascade-2142546263 None] Flow 'volume_create_manager' (1c3ab220-a1f3-40c3-a9ac-c3baca70199d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:48:08 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-fa9d7e31-2e49-4ae5-b9a1-167494ad1f13 tempest-VolumesDeleteCascade-2142546263 None] Created volume successfully. Apr 24 13:48:08 devstack cinder-volume[82046]: DEBUG cinder.image.image_utils [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_a52nmvandevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82046) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 24 13:48:08 devstack cinder-volume[82046]: INFO cinder.image.image_utils [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Image download 20.69 MB at 20.69 MB/s Apr 24 13:48:08 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[882037c4-b8bc-4b70-aacf-dc376d3ecae7]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:48:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_a52nmvandevstack@QuobyteHD {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:08 devstack sudo[85662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_a52nmvandevstack@QuobyteHD Apr 24 13:48:08 devstack sudo[85662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:09 devstack sudo[85660]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7cdadbec-89ed-407f-a1d4-a34387206e53 tempest-VolumesListAdminTestJSON-277972602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-da74171e-1312-498c-b7e1-4fa32691f232 1073741824" returned: 0 in 0.813s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7cdadbec-89ed-407f-a1d4-a34387206e53 tempest-VolumesListAdminTestJSON-277972602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-da74171e-1312-498c-b7e1-4fa32691f232 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:09 devstack sudo[85670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-da74171e-1312-498c-b7e1-4fa32691f232 Apr 24 13:48:09 devstack sudo[85670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:09 devstack sudo[85662]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_a52nmvandevstack@QuobyteHD" returned: 0 in 0.684s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:09 devstack cinder-volume[82046]: DEBUG cinder.image.image_utils [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Temporary image 02b8aec0-dc1c-4b93-81c4-ab6b88d472d9 is fetched for user 52bc9aff0b104aa19ab83685ea6380f8. {{(pid=82046) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 24 13:48:09 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[15927e8f-dfe1-46fc-8cbf-d217b35b2e78]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:48:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_a52nmvandevstack@QuobyteHD {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:09 devstack sudo[85672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_a52nmvandevstack@QuobyteHD Apr 24 13:48:09 devstack sudo[85672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d340e991-f734-465e-8d81-3ced49bbcfef tempest-VolumesDeleteCascade-2142546263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:48:09 devstack sudo[85670]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7cdadbec-89ed-407f-a1d4-a34387206e53 tempest-VolumesListAdminTestJSON-277972602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-da74171e-1312-498c-b7e1-4fa32691f232" returned: 0 in 0.569s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:09 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-7cdadbec-89ed-407f-a1d4-a34387206e53 tempest-VolumesListAdminTestJSON-277972602 None] <== create_volume: return (1460ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:48:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-7cdadbec-89ed-407f-a1d4-a34387206e53 tempest-VolumesListAdminTestJSON-277972602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:48:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d340e991-f734-465e-8d81-3ced49bbcfef tempest-VolumesDeleteCascade-2142546263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.228s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:48:09 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-d340e991-f734-465e-8d81-3ced49bbcfef tempest-VolumesDeleteCascade-2142546263 None] Creating offline snapshot 056a502c-87de-46c9-a90d-6622d3f3d307 of volume a8c1a971-0e28-43d9-a6e4-2741f60837e3 {{(pid=82046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 13:48:09 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-7cdadbec-89ed-407f-a1d4-a34387206e53 tempest-VolumesListAdminTestJSON-277972602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (058530af-b774-4f62-96b1-1026c01543ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da74171e-1312-498c-b7e1-4fa32691f232', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:09 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-7cdadbec-89ed-407f-a1d4-a34387206e53 tempest-VolumesListAdminTestJSON-277972602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b267e91-4ea1-46f9-9eb9-f5532cf04966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:09 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f55258-24e5-4cb5-a50c-386d46e3615e]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:48:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d340e991-f734-465e-8d81-3ced49bbcfef tempest-VolumesDeleteCascade-2142546263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:09 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-7cdadbec-89ed-407f-a1d4-a34387206e53 tempest-VolumesListAdminTestJSON-277972602 None] Volume volume-da74171e-1312-498c-b7e1-4fa32691f232 (da74171e-1312-498c-b7e1-4fa32691f232): created successfully Apr 24 13:48:09 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-7cdadbec-89ed-407f-a1d4-a34387206e53 tempest-VolumesListAdminTestJSON-277972602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b267e91-4ea1-46f9-9eb9-f5532cf04966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:09 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-7cdadbec-89ed-407f-a1d4-a34387206e53 tempest-VolumesListAdminTestJSON-277972602 None] Flow 'volume_create_manager' (321164d1-ff6f-41d1-b44c-e53a1b6a94ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:48:09 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-7cdadbec-89ed-407f-a1d4-a34387206e53 tempest-VolumesListAdminTestJSON-277972602 None] Created volume successfully. Apr 24 13:48:10 devstack sudo[85675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3 Apr 24 13:48:10 devstack sudo[85675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:10 devstack sudo[85672]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:10 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_a52nmvandevstack@QuobyteHD" returned: 0 in 0.664s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:10 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:48:10 devstack sudo[85675]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:10 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d340e991-f734-465e-8d81-3ced49bbcfef tempest-VolumesDeleteCascade-2142546263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3" returned: 0 in 0.725s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:10 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d340e991-f734-465e-8d81-3ced49bbcfef tempest-VolumesDeleteCascade-2142546263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.056a502c-87de-46c9-a90d-6622d3f3d307 1G {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:10 devstack sudo[85683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.056a502c-87de-46c9-a90d-6622d3f3d307 1G Apr 24 13:48:10 devstack sudo[85683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:11 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-43709bb5-f89f-4f6e-a329-e3981bb9e109 tempest-VolumesListAdminTestJSON-277972602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:48:11 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-43709bb5-f89f-4f6e-a329-e3981bb9e109 tempest-VolumesListAdminTestJSON-277972602 None] Flow 'volume_create_manager' (ffdfa36b-04ca-48ff-abdb-d486c20f2861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:48:11 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-43709bb5-f89f-4f6e-a329-e3981bb9e109 tempest-VolumesListAdminTestJSON-277972602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0c32452-29d3-4515-b48b-27298f5f504f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:11 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-43709bb5-f89f-4f6e-a329-e3981bb9e109 tempest-VolumesListAdminTestJSON-277972602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0c32452-29d3-4515-b48b-27298f5f504f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:48:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1178998517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=132ab4df-aad8-4b1c-8bea-8e0559e92153,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='184804f98a764331911aa81251c626a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:48:11Z,use_quota=True,user_id='99f61ba7295545a7a1abe1533ef8c1a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:11 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-43709bb5-f89f-4f6e-a329-e3981bb9e109 tempest-VolumesListAdminTestJSON-277972602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afe80fda-5e75-4822-aeeb-7a824bd0556a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:11 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-43709bb5-f89f-4f6e-a329-e3981bb9e109 tempest-VolumesListAdminTestJSON-277972602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afe80fda-5e75-4822-aeeb-7a824bd0556a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:11 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-43709bb5-f89f-4f6e-a329-e3981bb9e109 tempest-VolumesListAdminTestJSON-277972602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68c68e8f-17ca-466c-a426-d26e878c59d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:11 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-43709bb5-f89f-4f6e-a329-e3981bb9e109 tempest-VolumesListAdminTestJSON-277972602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68c68e8f-17ca-466c-a426-d26e878c59d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '132ab4df-aad8-4b1c-8bea-8e0559e92153', 'volume_name': 'volume-132ab4df-aad8-4b1c-8bea-8e0559e92153', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:11 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-43709bb5-f89f-4f6e-a329-e3981bb9e109 tempest-VolumesListAdminTestJSON-277972602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65ada85a-6597-4f28-b55a-10d568471837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:11 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-43709bb5-f89f-4f6e-a329-e3981bb9e109 tempest-VolumesListAdminTestJSON-277972602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65ada85a-6597-4f28-b55a-10d568471837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:11 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-43709bb5-f89f-4f6e-a329-e3981bb9e109 tempest-VolumesListAdminTestJSON-277972602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7823b5f7-a334-4602-a9ef-b32c1d0822f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:11 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-43709bb5-f89f-4f6e-a329-e3981bb9e109 tempest-VolumesListAdminTestJSON-277972602 None] Volume 132ab4df-aad8-4b1c-8bea-8e0559e92153: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-132ab4df-aad8-4b1c-8bea-8e0559e92153', 'volume_size': 1} Apr 24 13:48:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-43709bb5-f89f-4f6e-a329-e3981bb9e109 tempest-VolumesListAdminTestJSON-277972602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:48:11 devstack sudo[85683]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d340e991-f734-465e-8d81-3ced49bbcfef tempest-VolumesDeleteCascade-2142546263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.056a502c-87de-46c9-a90d-6622d3f3d307 1G" returned: 0 in 0.877s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d340e991-f734-465e-8d81-3ced49bbcfef tempest-VolumesDeleteCascade-2142546263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.056a502c-87de-46c9-a90d-6622d3f3d307 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:11 devstack sudo[85688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.056a502c-87de-46c9-a90d-6622d3f3d307 Apr 24 13:48:11 devstack sudo[85688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:11 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7c22fe2-2524-4175-a83b-c5bafd1b026b tempest-VolumeQuotasNegativeTestJSON-1674065836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:48:11 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b7c22fe2-2524-4175-a83b-c5bafd1b026b tempest-VolumeQuotasNegativeTestJSON-1674065836 None] Flow 'volume_create_manager' (2984b957-51a1-4f36-ad3b-403d235a54d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:48:11 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b7c22fe2-2524-4175-a83b-c5bafd1b026b tempest-VolumeQuotasNegativeTestJSON-1674065836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eca669af-169d-4b9e-9495-239e6607edf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:11 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b7c22fe2-2524-4175-a83b-c5bafd1b026b tempest-VolumeQuotasNegativeTestJSON-1674065836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eca669af-169d-4b9e-9495-239e6607edf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-244577972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f38ee04-a1ba-4a43-a832-23fc79f45e94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebd28f793df342dc8d25a39f77d4f91c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:48:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:48:12Z,use_quota=True,user_id='a41d2eb7197c4903a78c32d5ac4616b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:11 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b7c22fe2-2524-4175-a83b-c5bafd1b026b tempest-VolumeQuotasNegativeTestJSON-1674065836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b54927c2-54cd-413a-b45d-4e2709fe2f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:11 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b7c22fe2-2524-4175-a83b-c5bafd1b026b tempest-VolumeQuotasNegativeTestJSON-1674065836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b54927c2-54cd-413a-b45d-4e2709fe2f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:11 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b7c22fe2-2524-4175-a83b-c5bafd1b026b tempest-VolumeQuotasNegativeTestJSON-1674065836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a872675-3d79-4994-8370-2ea8815831c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:11 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b7c22fe2-2524-4175-a83b-c5bafd1b026b tempest-VolumeQuotasNegativeTestJSON-1674065836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a872675-3d79-4994-8370-2ea8815831c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f38ee04-a1ba-4a43-a832-23fc79f45e94', 'volume_name': 'volume-7f38ee04-a1ba-4a43-a832-23fc79f45e94', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:11 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b7c22fe2-2524-4175-a83b-c5bafd1b026b tempest-VolumeQuotasNegativeTestJSON-1674065836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b30e0f8-5d98-422b-953a-6c59435b6d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:11 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b7c22fe2-2524-4175-a83b-c5bafd1b026b tempest-VolumeQuotasNegativeTestJSON-1674065836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b30e0f8-5d98-422b-953a-6c59435b6d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:11 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b7c22fe2-2524-4175-a83b-c5bafd1b026b tempest-VolumeQuotasNegativeTestJSON-1674065836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3cd5270-3a35-4caf-86ea-1b292a5fd84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:11 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-b7c22fe2-2524-4175-a83b-c5bafd1b026b tempest-VolumeQuotasNegativeTestJSON-1674065836 None] Volume 7f38ee04-a1ba-4a43-a832-23fc79f45e94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f38ee04-a1ba-4a43-a832-23fc79f45e94', 'volume_size': 1} Apr 24 13:48:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b7c22fe2-2524-4175-a83b-c5bafd1b026b tempest-VolumeQuotasNegativeTestJSON-1674065836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:48:12 devstack sudo[85688]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d340e991-f734-465e-8d81-3ced49bbcfef tempest-VolumesDeleteCascade-2142546263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.056a502c-87de-46c9-a90d-6622d3f3d307" returned: 0 in 0.666s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:12 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-d340e991-f734-465e-8d81-3ced49bbcfef tempest-VolumesDeleteCascade-2142546263 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.056a502c-87de-46c9-a90d-6622d3f3d307 is being set with open permissions: ugo+rw Apr 24 13:48:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d340e991-f734-465e-8d81-3ced49bbcfef tempest-VolumesDeleteCascade-2142546263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.056a502c-87de-46c9-a90d-6622d3f3d307 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:12 devstack sudo[85693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.056a502c-87de-46c9-a90d-6622d3f3d307 Apr 24 13:48:12 devstack sudo[85693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:12 devstack sudo[85693]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d340e991-f734-465e-8d81-3ced49bbcfef tempest-VolumesDeleteCascade-2142546263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.056a502c-87de-46c9-a90d-6622d3f3d307" returned: 0 in 0.530s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d340e991-f734-465e-8d81-3ced49bbcfef tempest-VolumesDeleteCascade-2142546263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:12 devstack sudo[85696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.info Apr 24 13:48:12 devstack sudo[85696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:13 devstack sudo[85696]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d340e991-f734-465e-8d81-3ced49bbcfef tempest-VolumesDeleteCascade-2142546263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.info" returned: 0 in 0.566s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:13 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-d340e991-f734-465e-8d81-3ced49bbcfef tempest-VolumesDeleteCascade-2142546263 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.info is being set with open permissions: ugo+rw Apr 24 13:48:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d340e991-f734-465e-8d81-3ced49bbcfef tempest-VolumesDeleteCascade-2142546263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:13 devstack sudo[85699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.info Apr 24 13:48:13 devstack sudo[85699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:13 devstack sudo[85699]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d340e991-f734-465e-8d81-3ced49bbcfef tempest-VolumesDeleteCascade-2142546263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.info" returned: 0 in 0.496s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d340e991-f734-465e-8d81-3ced49bbcfef tempest-VolumesDeleteCascade-2142546263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.977s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:48:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.750s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:48:13 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:48:07Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5cbeb5d-8080-4519-a829-34efa5a0576d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fc671775a304cc789bb9beb3b8ba47b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:48:07Z,use_quota=True,user_id='52bc9aff0b104aa19ab83685ea6380f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:48:13 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Creating volume f5cbeb5d-8080-4519-a829-34efa5a0576d {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:48:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:48:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:48:13 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:48:13 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:48:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:48:13 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:48:13 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:48:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f5cbeb5d-8080-4519-a829-34efa5a0576d 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:13 devstack sudo[85702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f5cbeb5d-8080-4519-a829-34efa5a0576d 1073741824 Apr 24 13:48:13 devstack sudo[85702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:13 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-d340e991-f734-465e-8d81-3ced49bbcfef tempest-VolumesDeleteCascade-2142546263 None] Create snapshot completed successfully Apr 24 13:48:14 devstack sudo[85702]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f5cbeb5d-8080-4519-a829-34efa5a0576d 1073741824" returned: 0 in 0.779s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f5cbeb5d-8080-4519-a829-34efa5a0576d {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:14 devstack sudo[85741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f5cbeb5d-8080-4519-a829-34efa5a0576d Apr 24 13:48:14 devstack sudo[85741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-77ce60fb-a9e2-4239-ad62-5e4ee16112b6 tempest-VolumesDeleteCascade-2142546263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:48:15 devstack sudo[85741]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f5cbeb5d-8080-4519-a829-34efa5a0576d" returned: 0 in 0.572s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:15 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] <== create_volume: return (1396ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:48:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.400s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:48:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-43709bb5-f89f-4f6e-a329-e3981bb9e109 tempest-VolumesListAdminTestJSON-277972602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.052s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:48:15 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-43709bb5-f89f-4f6e-a329-e3981bb9e109 tempest-VolumesListAdminTestJSON-277972602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:48:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1178998517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=132ab4df-aad8-4b1c-8bea-8e0559e92153,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='184804f98a764331911aa81251c626a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:48:11Z,use_quota=True,user_id='99f61ba7295545a7a1abe1533ef8c1a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:48:15 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-43709bb5-f89f-4f6e-a329-e3981bb9e109 tempest-VolumesListAdminTestJSON-277972602 None] Creating volume 132ab4df-aad8-4b1c-8bea-8e0559e92153 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:48:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-43709bb5-f89f-4f6e-a329-e3981bb9e109 tempest-VolumesListAdminTestJSON-277972602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:48:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-43709bb5-f89f-4f6e-a329-e3981bb9e109 tempest-VolumesListAdminTestJSON-277972602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:48:15 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-43709bb5-f89f-4f6e-a329-e3981bb9e109 tempest-VolumesListAdminTestJSON-277972602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:48:15 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-43709bb5-f89f-4f6e-a329-e3981bb9e109 tempest-VolumesListAdminTestJSON-277972602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:48:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-43709bb5-f89f-4f6e-a329-e3981bb9e109 tempest-VolumesListAdminTestJSON-277972602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:48:15 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-43709bb5-f89f-4f6e-a329-e3981bb9e109 tempest-VolumesListAdminTestJSON-277972602 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:48:15 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-43709bb5-f89f-4f6e-a329-e3981bb9e109 tempest-VolumesListAdminTestJSON-277972602 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:48:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-43709bb5-f89f-4f6e-a329-e3981bb9e109 tempest-VolumesListAdminTestJSON-277972602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-132ab4df-aad8-4b1c-8bea-8e0559e92153 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:15 devstack sudo[85744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-132ab4df-aad8-4b1c-8bea-8e0559e92153 1073741824 Apr 24 13:48:15 devstack sudo[85744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:15 devstack cinder-volume[82046]: DEBUG cinder.volume.volume_utils [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Attempting download of 02b8aec0-dc1c-4b93-81c4-ab6b88d472d9 ((None, [{'url': 'file:///opt/stack/data/glance/images/02b8aec0-dc1c-4b93-81c4-ab6b88d472d9', 'metadata': {}}])) to volume f5cbeb5d-8080-4519-a829-34efa5a0576d. {{(pid=82046) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 24 13:48:15 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f52c6c-77e5-4552-8008-c1774b84bd3c]: (4, 'raw') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:48:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_79x8mswx {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:15 devstack sudo[85747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_79x8mswx Apr 24 13:48:15 devstack sudo[85747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:16 devstack sudo[85747]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:16 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_79x8mswx" returned: 0 in 0.689s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:16 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_79x8mswx {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:16 devstack sudo[85744]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:16 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-43709bb5-f89f-4f6e-a329-e3981bb9e109 tempest-VolumesListAdminTestJSON-277972602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-132ab4df-aad8-4b1c-8bea-8e0559e92153 1073741824" returned: 0 in 0.831s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:16 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-43709bb5-f89f-4f6e-a329-e3981bb9e109 tempest-VolumesListAdminTestJSON-277972602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-132ab4df-aad8-4b1c-8bea-8e0559e92153 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:16 devstack sudo[85755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-132ab4df-aad8-4b1c-8bea-8e0559e92153 Apr 24 13:48:16 devstack sudo[85755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:16 devstack sudo[85754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_79x8mswx Apr 24 13:48:16 devstack sudo[85754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:16 devstack sudo[85754]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:16 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_79x8mswx" returned: 1 in 0.556s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:16 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_79x8mswx' failed. Not Retrying. {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 13:48:16 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f363518-6c8e-47c1-8a84-10f41e7206eb]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:48:16 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_a52nmvandevstack@QuobyteHD {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:16 devstack sudo[85755]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:16 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-43709bb5-f89f-4f6e-a329-e3981bb9e109 tempest-VolumesListAdminTestJSON-277972602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-132ab4df-aad8-4b1c-8bea-8e0559e92153" returned: 0 in 0.547s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:16 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-43709bb5-f89f-4f6e-a329-e3981bb9e109 tempest-VolumesListAdminTestJSON-277972602 None] <== create_volume: return (1421ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:48:16 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-43709bb5-f89f-4f6e-a329-e3981bb9e109 tempest-VolumesListAdminTestJSON-277972602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.425s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:48:16 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b7c22fe2-2524-4175-a83b-c5bafd1b026b tempest-VolumeQuotasNegativeTestJSON-1674065836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.676s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:48:16 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b7c22fe2-2524-4175-a83b-c5bafd1b026b tempest-VolumeQuotasNegativeTestJSON-1674065836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-244577972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f38ee04-a1ba-4a43-a832-23fc79f45e94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebd28f793df342dc8d25a39f77d4f91c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:48:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:48:12Z,use_quota=True,user_id='a41d2eb7197c4903a78c32d5ac4616b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:48:16 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-b7c22fe2-2524-4175-a83b-c5bafd1b026b tempest-VolumeQuotasNegativeTestJSON-1674065836 None] Creating volume 7f38ee04-a1ba-4a43-a832-23fc79f45e94 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:48:16 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b7c22fe2-2524-4175-a83b-c5bafd1b026b tempest-VolumeQuotasNegativeTestJSON-1674065836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:48:16 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b7c22fe2-2524-4175-a83b-c5bafd1b026b tempest-VolumeQuotasNegativeTestJSON-1674065836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:48:16 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b7c22fe2-2524-4175-a83b-c5bafd1b026b tempest-VolumeQuotasNegativeTestJSON-1674065836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:48:16 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b7c22fe2-2524-4175-a83b-c5bafd1b026b tempest-VolumeQuotasNegativeTestJSON-1674065836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:48:16 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b7c22fe2-2524-4175-a83b-c5bafd1b026b tempest-VolumeQuotasNegativeTestJSON-1674065836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:48:16 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b7c22fe2-2524-4175-a83b-c5bafd1b026b tempest-VolumeQuotasNegativeTestJSON-1674065836 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:48:16 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-b7c22fe2-2524-4175-a83b-c5bafd1b026b tempest-VolumeQuotasNegativeTestJSON-1674065836 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:48:16 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b7c22fe2-2524-4175-a83b-c5bafd1b026b tempest-VolumeQuotasNegativeTestJSON-1674065836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7f38ee04-a1ba-4a43-a832-23fc79f45e94 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:16 devstack sudo[85761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_a52nmvandevstack@QuobyteHD Apr 24 13:48:16 devstack sudo[85761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:16 devstack sudo[85762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7f38ee04-a1ba-4a43-a832-23fc79f45e94 1073741824 Apr 24 13:48:16 devstack sudo[85762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:16 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-43709bb5-f89f-4f6e-a329-e3981bb9e109 tempest-VolumesListAdminTestJSON-277972602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7823b5f7-a334-4602-a9ef-b32c1d0822f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-132ab4df-aad8-4b1c-8bea-8e0559e92153', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:16 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-43709bb5-f89f-4f6e-a329-e3981bb9e109 tempest-VolumesListAdminTestJSON-277972602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d5bf42e-12a6-4a64-977d-e5d1224ee250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:16 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-43709bb5-f89f-4f6e-a329-e3981bb9e109 tempest-VolumesListAdminTestJSON-277972602 None] Volume volume-132ab4df-aad8-4b1c-8bea-8e0559e92153 (132ab4df-aad8-4b1c-8bea-8e0559e92153): created successfully Apr 24 13:48:16 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-43709bb5-f89f-4f6e-a329-e3981bb9e109 tempest-VolumesListAdminTestJSON-277972602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d5bf42e-12a6-4a64-977d-e5d1224ee250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:16 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-43709bb5-f89f-4f6e-a329-e3981bb9e109 tempest-VolumesListAdminTestJSON-277972602 None] Flow 'volume_create_manager' (ffdfa36b-04ca-48ff-abdb-d486c20f2861) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:48:16 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-43709bb5-f89f-4f6e-a329-e3981bb9e109 tempest-VolumesListAdminTestJSON-277972602 None] Created volume successfully. Apr 24 13:48:17 devstack sudo[85761]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_a52nmvandevstack@QuobyteHD" returned: 0 in 0.664s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:17 devstack cinder-volume[82046]: DEBUG cinder.image.image_utils [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] 02b8aec0-dc1c-4b93-81c4-ab6b88d472d9 was qcow2, converting to raw {{(pid=82046) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 24 13:48:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_a52nmvandevstack@QuobyteHD /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f5cbeb5d-8080-4519-a829-34efa5a0576d {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:17 devstack sudo[85771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_a52nmvandevstack@QuobyteHD /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f5cbeb5d-8080-4519-a829-34efa5a0576d Apr 24 13:48:17 devstack sudo[85771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:17 devstack sudo[85762]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b7c22fe2-2524-4175-a83b-c5bafd1b026b tempest-VolumeQuotasNegativeTestJSON-1674065836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7f38ee04-a1ba-4a43-a832-23fc79f45e94 1073741824" returned: 0 in 0.717s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b7c22fe2-2524-4175-a83b-c5bafd1b026b tempest-VolumeQuotasNegativeTestJSON-1674065836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7f38ee04-a1ba-4a43-a832-23fc79f45e94 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:17 devstack sudo[85773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7f38ee04-a1ba-4a43-a832-23fc79f45e94 Apr 24 13:48:17 devstack sudo[85773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:17 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-906700d2-3b13-4b4c-9946-a2f0bb378747 tempest-VolumesListAdminTestJSON-277972602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:48:18 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-906700d2-3b13-4b4c-9946-a2f0bb378747 tempest-VolumesListAdminTestJSON-277972602 None] Flow 'volume_create_manager' (6b60bea6-8179-469e-b0d9-d1239b291337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:48:18 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-906700d2-3b13-4b4c-9946-a2f0bb378747 tempest-VolumesListAdminTestJSON-277972602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2d65b21-a5a9-4a0b-b569-7ec7e2b1038b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:18 devstack sudo[85773]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:18 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b7c22fe2-2524-4175-a83b-c5bafd1b026b tempest-VolumeQuotasNegativeTestJSON-1674065836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7f38ee04-a1ba-4a43-a832-23fc79f45e94" returned: 0 in 0.614s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:18 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b7c22fe2-2524-4175-a83b-c5bafd1b026b tempest-VolumeQuotasNegativeTestJSON-1674065836 None] <== create_volume: return (1382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:48:18 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b7c22fe2-2524-4175-a83b-c5bafd1b026b tempest-VolumeQuotasNegativeTestJSON-1674065836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.386s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:48:18 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-77ce60fb-a9e2-4239-ad62-5e4ee16112b6 tempest-VolumesDeleteCascade-2142546263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:48:18 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-906700d2-3b13-4b4c-9946-a2f0bb378747 tempest-VolumesListAdminTestJSON-277972602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2d65b21-a5a9-4a0b-b569-7ec7e2b1038b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:48:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1235048779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28202506-f852-4be4-9fd0-a2ff24068bb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='184804f98a764331911aa81251c626a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:48:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:48:18Z,use_quota=True,user_id='99f61ba7295545a7a1abe1533ef8c1a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:18 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-906700d2-3b13-4b4c-9946-a2f0bb378747 tempest-VolumesListAdminTestJSON-277972602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44972752-423d-4e24-8d83-9c6e24310a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:18 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-906700d2-3b13-4b4c-9946-a2f0bb378747 tempest-VolumesListAdminTestJSON-277972602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44972752-423d-4e24-8d83-9c6e24310a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:18 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-906700d2-3b13-4b4c-9946-a2f0bb378747 tempest-VolumesListAdminTestJSON-277972602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2874dfb8-bc27-4e46-a281-7e07b1d5244d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:18 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-906700d2-3b13-4b4c-9946-a2f0bb378747 tempest-VolumesListAdminTestJSON-277972602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2874dfb8-bc27-4e46-a281-7e07b1d5244d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28202506-f852-4be4-9fd0-a2ff24068bb1', 'volume_name': 'volume-28202506-f852-4be4-9fd0-a2ff24068bb1', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:18 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-906700d2-3b13-4b4c-9946-a2f0bb378747 tempest-VolumesListAdminTestJSON-277972602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (786e500a-5eb8-48c6-aeab-82c30384cf2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:18 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-906700d2-3b13-4b4c-9946-a2f0bb378747 tempest-VolumesListAdminTestJSON-277972602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (786e500a-5eb8-48c6-aeab-82c30384cf2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:18 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-906700d2-3b13-4b4c-9946-a2f0bb378747 tempest-VolumesListAdminTestJSON-277972602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f49a75de-b541-49c2-b195-343ca0121f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:18 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-906700d2-3b13-4b4c-9946-a2f0bb378747 tempest-VolumesListAdminTestJSON-277972602 None] Volume 28202506-f852-4be4-9fd0-a2ff24068bb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28202506-f852-4be4-9fd0-a2ff24068bb1', 'volume_size': 1} Apr 24 13:48:18 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-906700d2-3b13-4b4c-9946-a2f0bb378747 tempest-VolumesListAdminTestJSON-277972602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:48:18 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b7c22fe2-2524-4175-a83b-c5bafd1b026b tempest-VolumeQuotasNegativeTestJSON-1674065836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3cd5270-3a35-4caf-86ea-1b292a5fd84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f38ee04-a1ba-4a43-a832-23fc79f45e94', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:18 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b7c22fe2-2524-4175-a83b-c5bafd1b026b tempest-VolumeQuotasNegativeTestJSON-1674065836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c1b4ea4-143a-4ca8-9779-8a6fd6b4970a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:18 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-77ce60fb-a9e2-4239-ad62-5e4ee16112b6 tempest-VolumesDeleteCascade-2142546263 None] Creating offline snapshot c3b69cdd-36db-4043-9f2f-13949914995b of volume a8c1a971-0e28-43d9-a6e4-2741f60837e3 {{(pid=82046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 13:48:18 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-b7c22fe2-2524-4175-a83b-c5bafd1b026b tempest-VolumeQuotasNegativeTestJSON-1674065836 None] Volume volume-7f38ee04-a1ba-4a43-a832-23fc79f45e94 (7f38ee04-a1ba-4a43-a832-23fc79f45e94): created successfully Apr 24 13:48:18 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b7c22fe2-2524-4175-a83b-c5bafd1b026b tempest-VolumeQuotasNegativeTestJSON-1674065836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c1b4ea4-143a-4ca8-9779-8a6fd6b4970a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:18 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b7c22fe2-2524-4175-a83b-c5bafd1b026b tempest-VolumeQuotasNegativeTestJSON-1674065836 None] Flow 'volume_create_manager' (2984b957-51a1-4f36-ad3b-403d235a54d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:48:18 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[a746d868-5ada-4d2f-8ab1-83a1cb2aad9b]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:48:18 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-77ce60fb-a9e2-4239-ad62-5e4ee16112b6 tempest-VolumesDeleteCascade-2142546263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.056a502c-87de-46c9-a90d-6622d3f3d307 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:18 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-b7c22fe2-2524-4175-a83b-c5bafd1b026b tempest-VolumeQuotasNegativeTestJSON-1674065836 None] Created volume successfully. Apr 24 13:48:18 devstack sudo[85781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.056a502c-87de-46c9-a90d-6622d3f3d307 Apr 24 13:48:18 devstack sudo[85781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:18 devstack sudo[85781]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:18 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-77ce60fb-a9e2-4239-ad62-5e4ee16112b6 tempest-VolumesDeleteCascade-2142546263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.056a502c-87de-46c9-a90d-6622d3f3d307" returned: 0 in 0.742s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:18 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-77ce60fb-a9e2-4239-ad62-5e4ee16112b6 tempest-VolumesDeleteCascade-2142546263 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:48:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-77ce60fb-a9e2-4239-ad62-5e4ee16112b6 tempest-VolumesDeleteCascade-2142546263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.056a502c-87de-46c9-a90d-6622d3f3d307,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.c3b69cdd-36db-4043-9f2f-13949914995b 1G {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:19 devstack sudo[85786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.056a502c-87de-46c9-a90d-6622d3f3d307,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.c3b69cdd-36db-4043-9f2f-13949914995b 1G Apr 24 13:48:19 devstack sudo[85786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:19 devstack sudo[85771]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_a52nmvandevstack@QuobyteHD /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f5cbeb5d-8080-4519-a829-34efa5a0576d" returned: 0 in 1.956s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:19 devstack cinder-volume[82046]: DEBUG cinder.image.image_utils [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_a52nmvandevstack@QuobyteHD, size 112.00 MB, duration 1.96 sec, destination /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f5cbeb5d-8080-4519-a829-34efa5a0576d {{(pid=82046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 13:48:19 devstack cinder-volume[82046]: INFO cinder.image.image_utils [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Converted 112.00 MB image at 57.18 MB/s Apr 24 13:48:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f5cbeb5d-8080-4519-a829-34efa5a0576d 1G {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:19 devstack sudo[85788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f5cbeb5d-8080-4519-a829-34efa5a0576d 1G Apr 24 13:48:19 devstack sudo[85788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:19 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-4e15d639-eae6-4d8b-b43c-bb0fc43ef38d tempest-VolumeQuotasNegativeTestJSON-1674065836 None] Acquiring lock "cinder-7f38ee04-a1ba-4a43-a832-23fc79f45e94-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:48:19 devstack sudo[85788]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f5cbeb5d-8080-4519-a829-34efa5a0576d 1G" returned: 0 in 0.594s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:19 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-4e15d639-eae6-4d8b-b43c-bb0fc43ef38d tempest-VolumeQuotasNegativeTestJSON-1674065836 None] Lock "cinder-7f38ee04-a1ba-4a43-a832-23fc79f45e94-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:48:19 devstack sudo[85786]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:19 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[6759ddd7-4e02-4808-a7c2-fa1de08e8461]: (4, 'raw') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:48:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f5cbeb5d-8080-4519-a829-34efa5a0576d {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-77ce60fb-a9e2-4239-ad62-5e4ee16112b6 tempest-VolumesDeleteCascade-2142546263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.056a502c-87de-46c9-a90d-6622d3f3d307,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.c3b69cdd-36db-4043-9f2f-13949914995b 1G" returned: 0 in 0.889s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-77ce60fb-a9e2-4239-ad62-5e4ee16112b6 tempest-VolumesDeleteCascade-2142546263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.056a502c-87de-46c9-a90d-6622d3f3d307 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.c3b69cdd-36db-4043-9f2f-13949914995b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:19 devstack sudo[85797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.056a502c-87de-46c9-a90d-6622d3f3d307 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.c3b69cdd-36db-4043-9f2f-13949914995b Apr 24 13:48:19 devstack sudo[85797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:19 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-4e15d639-eae6-4d8b-b43c-bb0fc43ef38d tempest-VolumeQuotasNegativeTestJSON-1674065836 None] Acquiring lock "cinder-quobyte-7f38ee04-a1ba-4a43-a832-23fc79f45e94" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:48:19 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-4e15d639-eae6-4d8b-b43c-bb0fc43ef38d tempest-VolumeQuotasNegativeTestJSON-1674065836 None] Lock "cinder-quobyte-7f38ee04-a1ba-4a43-a832-23fc79f45e94" acquired by "delete_volume" :: waited 0.015s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:48:19 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42f1b70-0c82-4222-ac9f-c495c2f270de]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:48:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4e15d639-eae6-4d8b-b43c-bb0fc43ef38d tempest-VolumeQuotasNegativeTestJSON-1674065836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7f38ee04-a1ba-4a43-a832-23fc79f45e94 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:20 devstack sudo[85796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f5cbeb5d-8080-4519-a829-34efa5a0576d Apr 24 13:48:20 devstack sudo[85796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:20 devstack sudo[85799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7f38ee04-a1ba-4a43-a832-23fc79f45e94 Apr 24 13:48:20 devstack sudo[85799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:20 devstack sudo[85796]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f5cbeb5d-8080-4519-a829-34efa5a0576d" returned: 0 in 0.709s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f5cbeb5d-8080-4519-a829-34efa5a0576d {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:20 devstack sudo[85799]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:20 devstack sudo[85797]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4e15d639-eae6-4d8b-b43c-bb0fc43ef38d tempest-VolumeQuotasNegativeTestJSON-1674065836 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7f38ee04-a1ba-4a43-a832-23fc79f45e94" returned: 0 in 0.615s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4e15d639-eae6-4d8b-b43c-bb0fc43ef38d tempest-VolumeQuotasNegativeTestJSON-1674065836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7f38ee04-a1ba-4a43-a832-23fc79f45e94 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-77ce60fb-a9e2-4239-ad62-5e4ee16112b6 tempest-VolumesDeleteCascade-2142546263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.056a502c-87de-46c9-a90d-6622d3f3d307 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.c3b69cdd-36db-4043-9f2f-13949914995b" returned: 0 in 0.722s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:20 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-77ce60fb-a9e2-4239-ad62-5e4ee16112b6 tempest-VolumesDeleteCascade-2142546263 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.c3b69cdd-36db-4043-9f2f-13949914995b is being set with open permissions: ugo+rw Apr 24 13:48:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-77ce60fb-a9e2-4239-ad62-5e4ee16112b6 tempest-VolumesDeleteCascade-2142546263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.c3b69cdd-36db-4043-9f2f-13949914995b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:20 devstack sudo[85811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7f38ee04-a1ba-4a43-a832-23fc79f45e94 Apr 24 13:48:20 devstack sudo[85811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:20 devstack sudo[85812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.c3b69cdd-36db-4043-9f2f-13949914995b Apr 24 13:48:20 devstack sudo[85812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:20 devstack sudo[85810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f5cbeb5d-8080-4519-a829-34efa5a0576d Apr 24 13:48:20 devstack sudo[85810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:21 devstack sudo[85811]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4e15d639-eae6-4d8b-b43c-bb0fc43ef38d tempest-VolumeQuotasNegativeTestJSON-1674065836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7f38ee04-a1ba-4a43-a832-23fc79f45e94" returned: 0 in 0.597s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:21 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-4e15d639-eae6-4d8b-b43c-bb0fc43ef38d tempest-VolumeQuotasNegativeTestJSON-1674065836 None] Lock "cinder-quobyte-7f38ee04-a1ba-4a43-a832-23fc79f45e94" released by "delete_volume" :: held 1.287s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:48:21 devstack sudo[85810]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:21 devstack sudo[85812]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-77ce60fb-a9e2-4239-ad62-5e4ee16112b6 tempest-VolumesDeleteCascade-2142546263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.c3b69cdd-36db-4043-9f2f-13949914995b" returned: 0 in 0.684s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f5cbeb5d-8080-4519-a829-34efa5a0576d" returned: 1 in 0.713s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f5cbeb5d-8080-4519-a829-34efa5a0576d' failed. Not Retrying. {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 13:48:21 devstack cinder-volume[82046]: DEBUG cinder.volume.volume_utils [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Downloaded image 02b8aec0-dc1c-4b93-81c4-ab6b88d472d9 ((None, [{'url': 'file:///opt/stack/data/glance/images/02b8aec0-dc1c-4b93-81c4-ab6b88d472d9', 'metadata': {}}])) to volume f5cbeb5d-8080-4519-a829-34efa5a0576d successfully. {{(pid=82046) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 24 13:48:21 devstack cinder-volume[82046]: DEBUG cinder.image.image_utils [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Temporary image 02b8aec0-dc1c-4b93-81c4-ab6b88d472d9 for user 52bc9aff0b104aa19ab83685ea6380f8 is deleted. {{(pid=82046) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 24 13:48:21 devstack cinder-volume[82046]: DEBUG cinder.volume.volume_utils [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Marking volume f5cbeb5d-8080-4519-a829-34efa5a0576d as bootable. {{(pid=82046) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 24 13:48:21 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Copying metadata from image 02b8aec0-dc1c-4b93-81c4-ab6b88d472d9 to f5cbeb5d-8080-4519-a829-34efa5a0576d. {{(pid=82046) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 24 13:48:21 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Creating volume glance metadata for volume f5cbeb5d-8080-4519-a829-34efa5a0576d backed by image 02b8aec0-dc1c-4b93-81c4-ab6b88d472d9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '02b8aec0-dc1c-4b93-81c4-ab6b88d472d9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82046) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 24 13:48:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-77ce60fb-a9e2-4239-ad62-5e4ee16112b6 tempest-VolumesDeleteCascade-2142546263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.298s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:48:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-906700d2-3b13-4b4c-9946-a2f0bb378747 tempest-VolumesListAdminTestJSON-277972602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.252s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:48:21 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-906700d2-3b13-4b4c-9946-a2f0bb378747 tempest-VolumesListAdminTestJSON-277972602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:48:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1235048779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28202506-f852-4be4-9fd0-a2ff24068bb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='184804f98a764331911aa81251c626a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:48:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:48:18Z,use_quota=True,user_id='99f61ba7295545a7a1abe1533ef8c1a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:48:21 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-906700d2-3b13-4b4c-9946-a2f0bb378747 tempest-VolumesListAdminTestJSON-277972602 None] Creating volume 28202506-f852-4be4-9fd0-a2ff24068bb1 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:48:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-906700d2-3b13-4b4c-9946-a2f0bb378747 tempest-VolumesListAdminTestJSON-277972602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:48:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-906700d2-3b13-4b4c-9946-a2f0bb378747 tempest-VolumesListAdminTestJSON-277972602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:48:21 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-906700d2-3b13-4b4c-9946-a2f0bb378747 tempest-VolumesListAdminTestJSON-277972602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:48:21 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-906700d2-3b13-4b4c-9946-a2f0bb378747 tempest-VolumesListAdminTestJSON-277972602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:48:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-906700d2-3b13-4b4c-9946-a2f0bb378747 tempest-VolumesListAdminTestJSON-277972602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:48:21 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-906700d2-3b13-4b4c-9946-a2f0bb378747 tempest-VolumesListAdminTestJSON-277972602 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:48:21 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-906700d2-3b13-4b4c-9946-a2f0bb378747 tempest-VolumesListAdminTestJSON-277972602 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:48:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-906700d2-3b13-4b4c-9946-a2f0bb378747 tempest-VolumesListAdminTestJSON-277972602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-28202506-f852-4be4-9fd0-a2ff24068bb1 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:21 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-4e15d639-eae6-4d8b-b43c-bb0fc43ef38d tempest-VolumeQuotasNegativeTestJSON-1674065836 None] Created reservations ['e9f0cc99-790e-4baa-be94-78e63bd9538b', 'ef061170-7f0c-441a-885b-67e1df1dec8f', '583ec92b-436e-4e2d-bc7f-4914f37321b0', '16e2a987-b0bf-4c1c-b184-68d055001398'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:48:21 devstack sudo[85821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-28202506-f852-4be4-9fd0-a2ff24068bb1 1073741824 Apr 24 13:48:21 devstack sudo[85821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:21 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-77ce60fb-a9e2-4239-ad62-5e4ee16112b6 tempest-VolumesDeleteCascade-2142546263 None] Create snapshot completed successfully Apr 24 13:48:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4e15d639-eae6-4d8b-b43c-bb0fc43ef38d tempest-VolumeQuotasNegativeTestJSON-1674065836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:48:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4e15d639-eae6-4d8b-b43c-bb0fc43ef38d tempest-VolumeQuotasNegativeTestJSON-1674065836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:48:21 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-4e15d639-eae6-4d8b-b43c-bb0fc43ef38d tempest-VolumeQuotasNegativeTestJSON-1674065836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:48:21 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-4e15d639-eae6-4d8b-b43c-bb0fc43ef38d tempest-VolumeQuotasNegativeTestJSON-1674065836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:48:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4e15d639-eae6-4d8b-b43c-bb0fc43ef38d tempest-VolumeQuotasNegativeTestJSON-1674065836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:48:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4e15d639-eae6-4d8b-b43c-bb0fc43ef38d tempest-VolumeQuotasNegativeTestJSON-1674065836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:21 devstack sudo[85823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:48:21 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8170bea3-0650-470a-b95d-bb87155d2011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5cbeb5d-8080-4519-a829-34efa5a0576d', 'volume_size': 1, 'image_id': '02b8aec0-dc1c-4b93-81c4-ab6b88d472d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02b8aec0-dc1c-4b93-81c4-ab6b88d472d9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db6d5b1c41254596bd8bad1e5f7bec28', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02b8aec0-dc1c-4b93-81c4-ab6b88d472d9', 'created_at': datetime.datetime(2026, 4, 24, 11, 39, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 11, 39, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02b8aec0-dc1c-4b93-81c4-ab6b88d472d9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:21 devstack sudo[85823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:21 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73f899e3-1f54-4de8-854d-df3d1cd31542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:21 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Volume volume-f5cbeb5d-8080-4519-a829-34efa5a0576d (f5cbeb5d-8080-4519-a829-34efa5a0576d): created successfully Apr 24 13:48:21 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73f899e3-1f54-4de8-854d-df3d1cd31542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:21 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Flow 'volume_create_manager' (46bc4f1f-e6fb-4e01-b0ca-6fe3df12aac6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:48:21 devstack cinder-volume[82046]: INFO cinder.volume.manager [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-055299c9-7185-432f-8150-eaca066a53fe tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Created volume successfully. Apr 24 13:48:22 devstack sudo[85823]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4e15d639-eae6-4d8b-b43c-bb0fc43ef38d tempest-VolumeQuotasNegativeTestJSON-1674065836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.605s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:22 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-4e15d639-eae6-4d8b-b43c-bb0fc43ef38d tempest-VolumeQuotasNegativeTestJSON-1674065836 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:48:22 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-4e15d639-eae6-4d8b-b43c-bb0fc43ef38d tempest-VolumeQuotasNegativeTestJSON-1674065836 None] Deleted volume successfully. Apr 24 13:48:22 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-4e15d639-eae6-4d8b-b43c-bb0fc43ef38d tempest-VolumeQuotasNegativeTestJSON-1674065836 None] Lock "cinder-7f38ee04-a1ba-4a43-a832-23fc79f45e94-delete_volume" released by "delete_volume" :: held 2.338s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:48:22 devstack sudo[85821]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-906700d2-3b13-4b4c-9946-a2f0bb378747 tempest-VolumesListAdminTestJSON-277972602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-28202506-f852-4be4-9fd0-a2ff24068bb1 1073741824" returned: 0 in 0.829s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-906700d2-3b13-4b4c-9946-a2f0bb378747 tempest-VolumesListAdminTestJSON-277972602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-28202506-f852-4be4-9fd0-a2ff24068bb1 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:22 devstack sudo[85829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-28202506-f852-4be4-9fd0-a2ff24068bb1 Apr 24 13:48:22 devstack sudo[85829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:22 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Acquiring lock "cinder-a8c1a971-0e28-43d9-a6e4-2741f60837e3-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:48:22 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Lock "cinder-a8c1a971-0e28-43d9-a6e4-2741f60837e3-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:48:22 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Performing cascade delete. {{(pid=82046) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 24 13:48:22 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Acquiring lock "cinder-056a502c-87de-46c9-a90d-6622d3f3d307-delete_snapshot" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:48:22 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Lock "cinder-056a502c-87de-46c9-a90d-6622d3f3d307-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:48:22 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Acquiring lock "cinder-quobyte-a8c1a971-0e28-43d9-a6e4-2741f60837e3" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:48:22 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Lock "cinder-quobyte-a8c1a971-0e28-43d9-a6e4-2741f60837e3" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:48:22 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Acquiring lock "cinder-quobyte-056a502c-87de-46c9-a90d-6622d3f3d307" by "_delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:48:22 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Lock "cinder-quobyte-056a502c-87de-46c9-a90d-6622d3f3d307" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:48:22 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Deleting offline snapshot 056a502c-87de-46c9-a90d-6622d3f3d307 of volume a8c1a971-0e28-43d9-a6e4-2741f60837e3 {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 13:48:22 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] snapshot_file for this snap is: volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.056a502c-87de-46c9-a90d-6622d3f3d307 {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 13:48:22 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac9d40e-0e1a-4574-bea5-43acf8a4beb8]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:48:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.056a502c-87de-46c9-a90d-6622d3f3d307 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-f9f21bfc-5b90-479d-baa9-0b7b347cb38d tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:48:22 devstack sudo[85839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.056a502c-87de-46c9-a90d-6622d3f3d307 Apr 24 13:48:22 devstack sudo[85839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:23 devstack sudo[85829]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:23 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-906700d2-3b13-4b4c-9946-a2f0bb378747 tempest-VolumesListAdminTestJSON-277972602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-28202506-f852-4be4-9fd0-a2ff24068bb1" returned: 0 in 0.764s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:23 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-906700d2-3b13-4b4c-9946-a2f0bb378747 tempest-VolumesListAdminTestJSON-277972602 None] <== create_volume: return (1655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:48:23 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-906700d2-3b13-4b4c-9946-a2f0bb378747 tempest-VolumesListAdminTestJSON-277972602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.658s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:48:23 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-f9f21bfc-5b90-479d-baa9-0b7b347cb38d tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.272s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:48:23 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-906700d2-3b13-4b4c-9946-a2f0bb378747 tempest-VolumesListAdminTestJSON-277972602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f49a75de-b541-49c2-b195-343ca0121f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28202506-f852-4be4-9fd0-a2ff24068bb1', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:23 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-906700d2-3b13-4b4c-9946-a2f0bb378747 tempest-VolumesListAdminTestJSON-277972602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (282b7b42-e099-4321-baed-e692d278fde6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:23 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[e061fb19-835a-49f2-bf9c-b743995619b6]: (4, 'raw') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:48:23 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-f9f21bfc-5b90-479d-baa9-0b7b347cb38d tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f5cbeb5d-8080-4519-a829-34efa5a0576d {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:23 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-906700d2-3b13-4b4c-9946-a2f0bb378747 tempest-VolumesListAdminTestJSON-277972602 None] Volume volume-28202506-f852-4be4-9fd0-a2ff24068bb1 (28202506-f852-4be4-9fd0-a2ff24068bb1): created successfully Apr 24 13:48:23 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-906700d2-3b13-4b4c-9946-a2f0bb378747 tempest-VolumesListAdminTestJSON-277972602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (282b7b42-e099-4321-baed-e692d278fde6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:23 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-906700d2-3b13-4b4c-9946-a2f0bb378747 tempest-VolumesListAdminTestJSON-277972602 None] Flow 'volume_create_manager' (6b60bea6-8179-469e-b0d9-d1239b291337) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:48:23 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-906700d2-3b13-4b4c-9946-a2f0bb378747 tempest-VolumesListAdminTestJSON-277972602 None] Created volume successfully. Apr 24 13:48:23 devstack sudo[85842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f5cbeb5d-8080-4519-a829-34efa5a0576d Apr 24 13:48:23 devstack sudo[85842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:23 devstack sudo[85839]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:23 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.056a502c-87de-46c9-a90d-6622d3f3d307" returned: 0 in 0.807s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:23 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:48:23 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[c107738d-670b-4ee6-a976-9bf369bff7a5]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:48:23 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:23 devstack sudo[85849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3 Apr 24 13:48:23 devstack sudo[85849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:23 devstack sudo[85842]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:23 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-f9f21bfc-5b90-479d-baa9-0b7b347cb38d tempest-ServerBootFromVolumeStableRescueTest-9833111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f5cbeb5d-8080-4519-a829-34efa5a0576d" returned: 0 in 0.818s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:23 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-f9f21bfc-5b90-479d-baa9-0b7b347cb38d tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f5cbeb5d-8080-4519-a829-34efa5a0576d {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:23 devstack sudo[85853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f5cbeb5d-8080-4519-a829-34efa5a0576d Apr 24 13:48:23 devstack sudo[85853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:24 devstack sudo[85849]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3" returned: 0 in 0.825s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:24 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[367b7d34-72b3-47bc-81a6-bfbc6f8502c2]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:48:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.c3b69cdd-36db-4043-9f2f-13949914995b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:24 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fa2b250-6355-4a1a-b223-08b0c639fe56 tempest-VolumesListAdminTestJSON-1436920875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:48:24 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4fa2b250-6355-4a1a-b223-08b0c639fe56 tempest-VolumesListAdminTestJSON-1436920875 None] Flow 'volume_create_manager' (93881385-20eb-4504-808c-3f25c1309ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:48:24 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4fa2b250-6355-4a1a-b223-08b0c639fe56 tempest-VolumesListAdminTestJSON-1436920875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b52f68c1-2955-46c1-8e54-b80188de8f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:24 devstack sudo[85858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.c3b69cdd-36db-4043-9f2f-13949914995b Apr 24 13:48:24 devstack sudo[85858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:24 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4fa2b250-6355-4a1a-b223-08b0c639fe56 tempest-VolumesListAdminTestJSON-1436920875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b52f68c1-2955-46c1-8e54-b80188de8f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:48:24Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7cb3b42-bb4b-4cb0-ad30-6fa361c6bf7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3e1b9e3e29429dae9d6163e79596cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:48:25Z,use_quota=True,user_id='a716e252807b47abb718b4bb3c6b7e3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:24 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4fa2b250-6355-4a1a-b223-08b0c639fe56 tempest-VolumesListAdminTestJSON-1436920875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98b9d528-cf44-4a41-9c27-a0643e568719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:24 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4fa2b250-6355-4a1a-b223-08b0c639fe56 tempest-VolumesListAdminTestJSON-1436920875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98b9d528-cf44-4a41-9c27-a0643e568719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:24 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4fa2b250-6355-4a1a-b223-08b0c639fe56 tempest-VolumesListAdminTestJSON-1436920875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0de1256-9b5a-4e4e-bcbe-ec296473016a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:24 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4fa2b250-6355-4a1a-b223-08b0c639fe56 tempest-VolumesListAdminTestJSON-1436920875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0de1256-9b5a-4e4e-bcbe-ec296473016a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7cb3b42-bb4b-4cb0-ad30-6fa361c6bf7c', 'volume_name': 'volume-a7cb3b42-bb4b-4cb0-ad30-6fa361c6bf7c', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:24 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4fa2b250-6355-4a1a-b223-08b0c639fe56 tempest-VolumesListAdminTestJSON-1436920875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8503166-c855-4200-9bf5-8bde2989f703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:24 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4fa2b250-6355-4a1a-b223-08b0c639fe56 tempest-VolumesListAdminTestJSON-1436920875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8503166-c855-4200-9bf5-8bde2989f703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:24 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4fa2b250-6355-4a1a-b223-08b0c639fe56 tempest-VolumesListAdminTestJSON-1436920875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (583970ef-78d3-4a7f-acf6-a11c42012b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:24 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-4fa2b250-6355-4a1a-b223-08b0c639fe56 tempest-VolumesListAdminTestJSON-1436920875 None] Volume a7cb3b42-bb4b-4cb0-ad30-6fa361c6bf7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7cb3b42-bb4b-4cb0-ad30-6fa361c6bf7c', 'volume_size': 1} Apr 24 13:48:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4fa2b250-6355-4a1a-b223-08b0c639fe56 tempest-VolumesListAdminTestJSON-1436920875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:48:24 devstack sudo[85853]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-f9f21bfc-5b90-479d-baa9-0b7b347cb38d tempest-ServerBootFromVolumeStableRescueTest-9833111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f5cbeb5d-8080-4519-a829-34efa5a0576d" returned: 1 in 0.873s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-f9f21bfc-5b90-479d-baa9-0b7b347cb38d tempest-ServerBootFromVolumeStableRescueTest-9833111 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f5cbeb5d-8080-4519-a829-34efa5a0576d' failed. Not Retrying. {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 13:48:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-f9f21bfc-5b90-479d-baa9-0b7b347cb38d tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.736s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:48:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4fa2b250-6355-4a1a-b223-08b0c639fe56 tempest-VolumesListAdminTestJSON-1436920875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.070s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:48:24 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-4fa2b250-6355-4a1a-b223-08b0c639fe56 tempest-VolumesListAdminTestJSON-1436920875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:48:24Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7cb3b42-bb4b-4cb0-ad30-6fa361c6bf7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3e1b9e3e29429dae9d6163e79596cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:48:25Z,use_quota=True,user_id='a716e252807b47abb718b4bb3c6b7e3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:48:24 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-4fa2b250-6355-4a1a-b223-08b0c639fe56 tempest-VolumesListAdminTestJSON-1436920875 None] Creating volume a7cb3b42-bb4b-4cb0-ad30-6fa361c6bf7c {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:48:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4fa2b250-6355-4a1a-b223-08b0c639fe56 tempest-VolumesListAdminTestJSON-1436920875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:48:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4fa2b250-6355-4a1a-b223-08b0c639fe56 tempest-VolumesListAdminTestJSON-1436920875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:48:24 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-4fa2b250-6355-4a1a-b223-08b0c639fe56 tempest-VolumesListAdminTestJSON-1436920875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:48:24 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-4fa2b250-6355-4a1a-b223-08b0c639fe56 tempest-VolumesListAdminTestJSON-1436920875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:48:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4fa2b250-6355-4a1a-b223-08b0c639fe56 tempest-VolumesListAdminTestJSON-1436920875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:48:24 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-4fa2b250-6355-4a1a-b223-08b0c639fe56 tempest-VolumesListAdminTestJSON-1436920875 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:48:24 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-4fa2b250-6355-4a1a-b223-08b0c639fe56 tempest-VolumesListAdminTestJSON-1436920875 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:48:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4fa2b250-6355-4a1a-b223-08b0c639fe56 tempest-VolumesListAdminTestJSON-1436920875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a7cb3b42-bb4b-4cb0-ad30-6fa361c6bf7c 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:24 devstack sudo[85863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a7cb3b42-bb4b-4cb0-ad30-6fa361c6bf7c 1073741824 Apr 24 13:48:24 devstack sudo[85863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:24 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-f9f21bfc-5b90-479d-baa9-0b7b347cb38d tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23', 'name': 'volume-f5cbeb5d-8080-4519-a829-34efa5a0576d', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ade16f18-fb7a-4fb7-b8b4-2768236aa689', 'enforce_multipath': True} {{(pid=82046) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 24 13:48:24 devstack cinder-volume[82046]: INFO cinder.volume.manager [req-f1fe5bd2-fb4f-4f78-8168-c835bd172f36 req-f9f21bfc-5b90-479d-baa9-0b7b347cb38d tempest-ServerBootFromVolumeStableRescueTest-9833111 None] attachment_update completed successfully. Apr 24 13:48:25 devstack sudo[85858]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:25 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.c3b69cdd-36db-4043-9f2f-13949914995b" returned: 0 in 0.799s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:25 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:48:25 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba41c23f-8aac-4802-9959-6ef80744b7b3]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:48:25 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.056a502c-87de-46c9-a90d-6622d3f3d307 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:25 devstack sudo[85869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.056a502c-87de-46c9-a90d-6622d3f3d307 Apr 24 13:48:25 devstack sudo[85869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:25 devstack sudo[85863]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:25 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4fa2b250-6355-4a1a-b223-08b0c639fe56 tempest-VolumesListAdminTestJSON-1436920875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a7cb3b42-bb4b-4cb0-ad30-6fa361c6bf7c 1073741824" returned: 0 in 0.926s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:25 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4fa2b250-6355-4a1a-b223-08b0c639fe56 tempest-VolumesListAdminTestJSON-1436920875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a7cb3b42-bb4b-4cb0-ad30-6fa361c6bf7c {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:25 devstack sudo[85874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a7cb3b42-bb4b-4cb0-ad30-6fa361c6bf7c Apr 24 13:48:25 devstack sudo[85874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:26 devstack sudo[85869]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.056a502c-87de-46c9-a90d-6622d3f3d307" returned: 0 in 0.715s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:26 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:48:26 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be43272-b915-4ea4-a84e-6f203ff79fa7]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:48:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:26 devstack sudo[85879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3 Apr 24 13:48:26 devstack sudo[85879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:26 devstack sudo[85874]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4fa2b250-6355-4a1a-b223-08b0c639fe56 tempest-VolumesListAdminTestJSON-1436920875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a7cb3b42-bb4b-4cb0-ad30-6fa361c6bf7c" returned: 0 in 0.637s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:26 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-4fa2b250-6355-4a1a-b223-08b0c639fe56 tempest-VolumesListAdminTestJSON-1436920875 None] <== create_volume: return (1611ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:48:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4fa2b250-6355-4a1a-b223-08b0c639fe56 tempest-VolumesListAdminTestJSON-1436920875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.614s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:48:26 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4fa2b250-6355-4a1a-b223-08b0c639fe56 tempest-VolumesListAdminTestJSON-1436920875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (583970ef-78d3-4a7f-acf6-a11c42012b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7cb3b42-bb4b-4cb0-ad30-6fa361c6bf7c', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:26 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4fa2b250-6355-4a1a-b223-08b0c639fe56 tempest-VolumesListAdminTestJSON-1436920875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3df90d88-8a30-4ec4-9382-0c3cdee4c7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:26 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-4fa2b250-6355-4a1a-b223-08b0c639fe56 tempest-VolumesListAdminTestJSON-1436920875 None] Volume volume-a7cb3b42-bb4b-4cb0-ad30-6fa361c6bf7c (a7cb3b42-bb4b-4cb0-ad30-6fa361c6bf7c): created successfully Apr 24 13:48:26 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4fa2b250-6355-4a1a-b223-08b0c639fe56 tempest-VolumesListAdminTestJSON-1436920875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3df90d88-8a30-4ec4-9382-0c3cdee4c7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:26 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4fa2b250-6355-4a1a-b223-08b0c639fe56 tempest-VolumesListAdminTestJSON-1436920875 None] Flow 'volume_create_manager' (93881385-20eb-4504-808c-3f25c1309ee6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:48:26 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-4fa2b250-6355-4a1a-b223-08b0c639fe56 tempest-VolumesListAdminTestJSON-1436920875 None] Created volume successfully. Apr 24 13:48:26 devstack sudo[85879]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3" returned: 0 in 0.691s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.056a502c-87de-46c9-a90d-6622d3f3d307 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:26 devstack sudo[85885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.056a502c-87de-46c9-a90d-6622d3f3d307 Apr 24 13:48:26 devstack sudo[85885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:26 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-0fd18166-62a5-4089-9af5-9956fd26bc75 tempest-VolumesListAdminTestJSON-1436920875 None] Acquiring lock "cinder-a7cb3b42-bb4b-4cb0-ad30-6fa361c6bf7c-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:48:27 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-0fd18166-62a5-4089-9af5-9956fd26bc75 tempest-VolumesListAdminTestJSON-1436920875 None] Lock "cinder-a7cb3b42-bb4b-4cb0-ad30-6fa361c6bf7c-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:48:27 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-0fd18166-62a5-4089-9af5-9956fd26bc75 tempest-VolumesListAdminTestJSON-1436920875 None] Acquiring lock "cinder-quobyte-a7cb3b42-bb4b-4cb0-ad30-6fa361c6bf7c" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:48:27 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-0fd18166-62a5-4089-9af5-9956fd26bc75 tempest-VolumesListAdminTestJSON-1436920875 None] Lock "cinder-quobyte-a7cb3b42-bb4b-4cb0-ad30-6fa361c6bf7c" acquired by "delete_volume" :: waited 0.037s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:48:27 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1a68a2-c501-4833-bb94-8d1f5ea7674b]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:48:27 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0fd18166-62a5-4089-9af5-9956fd26bc75 tempest-VolumesListAdminTestJSON-1436920875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a7cb3b42-bb4b-4cb0-ad30-6fa361c6bf7c {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:27 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-8ff7ce6d-9300-4059-85c2-b89968ecda6d tempest-VolumesListAdminTestJSON-277972602 None] Acquiring lock "cinder-28202506-f852-4be4-9fd0-a2ff24068bb1-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:48:27 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-8ff7ce6d-9300-4059-85c2-b89968ecda6d tempest-VolumesListAdminTestJSON-277972602 None] Lock "cinder-28202506-f852-4be4-9fd0-a2ff24068bb1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:48:27 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-8ff7ce6d-9300-4059-85c2-b89968ecda6d tempest-VolumesListAdminTestJSON-277972602 None] Acquiring lock "cinder-quobyte-28202506-f852-4be4-9fd0-a2ff24068bb1" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:48:27 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-8ff7ce6d-9300-4059-85c2-b89968ecda6d tempest-VolumesListAdminTestJSON-277972602 None] Lock "cinder-quobyte-28202506-f852-4be4-9fd0-a2ff24068bb1" acquired by "delete_volume" :: waited 0.016s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:48:27 devstack sudo[85887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a7cb3b42-bb4b-4cb0-ad30-6fa361c6bf7c Apr 24 13:48:27 devstack sudo[85887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:27 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[13652025-7856-4f26-a605-0ecc69f3efb1]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:48:27 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8ff7ce6d-9300-4059-85c2-b89968ecda6d tempest-VolumesListAdminTestJSON-277972602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-28202506-f852-4be4-9fd0-a2ff24068bb1 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:27 devstack sudo[85889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-28202506-f852-4be4-9fd0-a2ff24068bb1 Apr 24 13:48:27 devstack sudo[85889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:27 devstack sudo[85885]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:27 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.056a502c-87de-46c9-a90d-6622d3f3d307" returned: 0 in 0.847s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:27 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.056a502c-87de-46c9-a90d-6622d3f3d307 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:27 devstack sudo[85894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.056a502c-87de-46c9-a90d-6622d3f3d307 Apr 24 13:48:27 devstack sudo[85894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:27 devstack sudo[85887]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:27 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0fd18166-62a5-4089-9af5-9956fd26bc75 tempest-VolumesListAdminTestJSON-1436920875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a7cb3b42-bb4b-4cb0-ad30-6fa361c6bf7c" returned: 0 in 0.756s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:27 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0fd18166-62a5-4089-9af5-9956fd26bc75 tempest-VolumesListAdminTestJSON-1436920875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a7cb3b42-bb4b-4cb0-ad30-6fa361c6bf7c {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:27 devstack sudo[85902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a7cb3b42-bb4b-4cb0-ad30-6fa361c6bf7c Apr 24 13:48:27 devstack sudo[85902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:28 devstack sudo[85889]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8ff7ce6d-9300-4059-85c2-b89968ecda6d tempest-VolumesListAdminTestJSON-277972602 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-28202506-f852-4be4-9fd0-a2ff24068bb1" returned: 0 in 0.741s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8ff7ce6d-9300-4059-85c2-b89968ecda6d tempest-VolumesListAdminTestJSON-277972602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-28202506-f852-4be4-9fd0-a2ff24068bb1 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:28 devstack sudo[85907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-28202506-f852-4be4-9fd0-a2ff24068bb1 Apr 24 13:48:28 devstack sudo[85907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:28 devstack sudo[85894]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.056a502c-87de-46c9-a90d-6622d3f3d307" returned: 0 in 0.951s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.c3b69cdd-36db-4043-9f2f-13949914995b -F qcow2 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:28 devstack sudo[85911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.c3b69cdd-36db-4043-9f2f-13949914995b -F qcow2 Apr 24 13:48:28 devstack sudo[85911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:28 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-d26b0118-5fc6-4a7f-8637-286b00f3e17d tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:48:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d26b0118-5fc6-4a7f-8637-286b00f3e17d tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Flow 'volume_create_manager' (5cdf76f3-2dd7-4030-99ea-e682118a67e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:48:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d26b0118-5fc6-4a7f-8637-286b00f3e17d tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b49c6a5-9695-4956-89bc-78ebb1bf6d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:28 devstack sudo[85902]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d26b0118-5fc6-4a7f-8637-286b00f3e17d tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b49c6a5-9695-4956-89bc-78ebb1bf6d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1857835444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a62c778-9f9b-4497-8542-c907e50bb429,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8271ae9f17c4899b843d9f4a7dfb424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:48:29Z,use_quota=True,user_id='2f8407e1d38747c0bc1ecf531bdf51c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63967a11-33a1-4ab5-a1fe-0349b55d275e),volume_type_id=63967a11-33a1-4ab5-a1fe-0349b55d275e)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d26b0118-5fc6-4a7f-8637-286b00f3e17d tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a16593f-4342-4ca0-a02f-6a37e1e147c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d26b0118-5fc6-4a7f-8637-286b00f3e17d tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a16593f-4342-4ca0-a02f-6a37e1e147c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d26b0118-5fc6-4a7f-8637-286b00f3e17d tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b15a6a3-0d06-4217-b186-29e686813b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d26b0118-5fc6-4a7f-8637-286b00f3e17d tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b15a6a3-0d06-4217-b186-29e686813b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a62c778-9f9b-4497-8542-c907e50bb429', 'volume_name': 'volume-7a62c778-9f9b-4497-8542-c907e50bb429', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d26b0118-5fc6-4a7f-8637-286b00f3e17d tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8cdeaa7-cfe1-4874-a020-f72fa7fe53c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d26b0118-5fc6-4a7f-8637-286b00f3e17d tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8cdeaa7-cfe1-4874-a020-f72fa7fe53c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d26b0118-5fc6-4a7f-8637-286b00f3e17d tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21b5b982-6d24-49bd-9469-3c1b0d908dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:28 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-d26b0118-5fc6-4a7f-8637-286b00f3e17d tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Volume 7a62c778-9f9b-4497-8542-c907e50bb429: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a62c778-9f9b-4497-8542-c907e50bb429', 'volume_size': 1} Apr 24 13:48:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d26b0118-5fc6-4a7f-8637-286b00f3e17d tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:48:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d26b0118-5fc6-4a7f-8637-286b00f3e17d tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:48:28 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-d26b0118-5fc6-4a7f-8637-286b00f3e17d tempest-VolumeRetypeWithoutMigrationTest-439811691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1857835444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a62c778-9f9b-4497-8542-c907e50bb429,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8271ae9f17c4899b843d9f4a7dfb424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:48:29Z,use_quota=True,user_id='2f8407e1d38747c0bc1ecf531bdf51c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63967a11-33a1-4ab5-a1fe-0349b55d275e),volume_type_id=63967a11-33a1-4ab5-a1fe-0349b55d275e)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:48:28 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-d26b0118-5fc6-4a7f-8637-286b00f3e17d tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Creating volume 7a62c778-9f9b-4497-8542-c907e50bb429 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:48:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d26b0118-5fc6-4a7f-8637-286b00f3e17d tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:48:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d26b0118-5fc6-4a7f-8637-286b00f3e17d tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:48:28 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-d26b0118-5fc6-4a7f-8637-286b00f3e17d tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:48:28 devstack sudo[85907]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:28 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-d26b0118-5fc6-4a7f-8637-286b00f3e17d tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:48:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d26b0118-5fc6-4a7f-8637-286b00f3e17d tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:48:28 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-d26b0118-5fc6-4a7f-8637-286b00f3e17d tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:48:28 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-d26b0118-5fc6-4a7f-8637-286b00f3e17d tempest-VolumeRetypeWithoutMigrationTest-439811691 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:48:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d26b0118-5fc6-4a7f-8637-286b00f3e17d tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7a62c778-9f9b-4497-8542-c907e50bb429 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8ff7ce6d-9300-4059-85c2-b89968ecda6d tempest-VolumesListAdminTestJSON-277972602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-28202506-f852-4be4-9fd0-a2ff24068bb1" returned: 0 in 0.665s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0fd18166-62a5-4089-9af5-9956fd26bc75 tempest-VolumesListAdminTestJSON-1436920875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a7cb3b42-bb4b-4cb0-ad30-6fa361c6bf7c" returned: 0 in 0.797s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:28 devstack sudo[85914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7a62c778-9f9b-4497-8542-c907e50bb429 1073741824 Apr 24 13:48:28 devstack sudo[85914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:28 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-8ff7ce6d-9300-4059-85c2-b89968ecda6d tempest-VolumesListAdminTestJSON-277972602 None] Lock "cinder-quobyte-28202506-f852-4be4-9fd0-a2ff24068bb1" released by "delete_volume" :: held 1.468s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:48:28 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-0fd18166-62a5-4089-9af5-9956fd26bc75 tempest-VolumesListAdminTestJSON-1436920875 None] Lock "cinder-quobyte-a7cb3b42-bb4b-4cb0-ad30-6fa361c6bf7c" released by "delete_volume" :: held 1.621s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:48:28 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-8ff7ce6d-9300-4059-85c2-b89968ecda6d tempest-VolumesListAdminTestJSON-277972602 None] Created reservations ['f28bff09-0123-4c7f-a5e1-326e3122034d', 'bec50d20-884c-414b-a1a7-d8c6a3eba8ab', 'c6000a8a-3f87-46bb-bd43-b2df234ef22e', '4ccd2acd-14df-43b8-b2f8-d1e7f5df22cb'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:48:28 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-0fd18166-62a5-4089-9af5-9956fd26bc75 tempest-VolumesListAdminTestJSON-1436920875 None] Created reservations ['19d0e7a3-6eef-4c60-b7da-6489b28da131', '28b7ec16-35cd-43cc-bab4-5d62f4a992fa', 'cfd3fb76-905d-49b3-9029-b93f57cb4bca', 'bad7257a-1430-47ab-a36c-b354ea4611ed'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:48:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0fd18166-62a5-4089-9af5-9956fd26bc75 tempest-VolumesListAdminTestJSON-1436920875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:48:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0fd18166-62a5-4089-9af5-9956fd26bc75 tempest-VolumesListAdminTestJSON-1436920875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:48:28 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-0fd18166-62a5-4089-9af5-9956fd26bc75 tempest-VolumesListAdminTestJSON-1436920875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:48:28 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-0fd18166-62a5-4089-9af5-9956fd26bc75 tempest-VolumesListAdminTestJSON-1436920875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:48:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0fd18166-62a5-4089-9af5-9956fd26bc75 tempest-VolumesListAdminTestJSON-1436920875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:48:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0fd18166-62a5-4089-9af5-9956fd26bc75 tempest-VolumesListAdminTestJSON-1436920875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-8ff7ce6d-9300-4059-85c2-b89968ecda6d tempest-VolumesListAdminTestJSON-277972602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:48:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-8ff7ce6d-9300-4059-85c2-b89968ecda6d tempest-VolumesListAdminTestJSON-277972602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:48:28 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-8ff7ce6d-9300-4059-85c2-b89968ecda6d tempest-VolumesListAdminTestJSON-277972602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:48:28 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-8ff7ce6d-9300-4059-85c2-b89968ecda6d tempest-VolumesListAdminTestJSON-277972602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:48:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-8ff7ce6d-9300-4059-85c2-b89968ecda6d tempest-VolumesListAdminTestJSON-277972602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:48:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8ff7ce6d-9300-4059-85c2-b89968ecda6d tempest-VolumesListAdminTestJSON-277972602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:28 devstack sudo[85916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:48:28 devstack sudo[85916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:28 devstack sudo[85917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:48:28 devstack sudo[85917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:29 devstack sudo[85911]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.c3b69cdd-36db-4043-9f2f-13949914995b -F qcow2" returned: 0 in 0.775s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:29 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Lock "cinder-quobyte-056a502c-87de-46c9-a90d-6622d3f3d307" released by "_delete_snapshot" :: held 6.638s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:48:29 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Lock "cinder-quobyte-a8c1a971-0e28-43d9-a6e4-2741f60837e3" released by "delete_snapshot" :: held 6.663s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:48:29 devstack sudo[85914]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d26b0118-5fc6-4a7f-8637-286b00f3e17d tempest-VolumeRetypeWithoutMigrationTest-439811691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7a62c778-9f9b-4497-8542-c907e50bb429 1073741824" returned: 0 in 0.678s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:29 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Created reservations ['578fb5fb-c2a3-4270-8cf0-78487a79efaa', '24efcc99-a6f3-4905-a83c-969784538178', '7463e71a-2fc5-4928-b12f-8c9c6e0e632a', '556ff87f-14e7-4241-8038-9d7490461ba5'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:48:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d26b0118-5fc6-4a7f-8637-286b00f3e17d tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7a62c778-9f9b-4497-8542-c907e50bb429 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:29 devstack sudo[85917]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:29 devstack sudo[85928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7a62c778-9f9b-4497-8542-c907e50bb429 Apr 24 13:48:29 devstack sudo[85928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8ff7ce6d-9300-4059-85c2-b89968ecda6d tempest-VolumesListAdminTestJSON-277972602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.548s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:29 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-8ff7ce6d-9300-4059-85c2-b89968ecda6d tempest-VolumesListAdminTestJSON-277972602 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:48:29 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Delete snapshot completed successfully. Apr 24 13:48:29 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-8ff7ce6d-9300-4059-85c2-b89968ecda6d tempest-VolumesListAdminTestJSON-277972602 None] Deleted volume successfully. Apr 24 13:48:29 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Lock "cinder-056a502c-87de-46c9-a90d-6622d3f3d307-delete_snapshot" released by "delete_snapshot" :: held 6.862s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:48:29 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Acquiring lock "cinder-c3b69cdd-36db-4043-9f2f-13949914995b-delete_snapshot" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:48:29 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Lock "cinder-c3b69cdd-36db-4043-9f2f-13949914995b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:48:29 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Acquiring lock "cinder-quobyte-a8c1a971-0e28-43d9-a6e4-2741f60837e3" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:48:29 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-8ff7ce6d-9300-4059-85c2-b89968ecda6d tempest-VolumesListAdminTestJSON-277972602 None] Lock "cinder-28202506-f852-4be4-9fd0-a2ff24068bb1-delete_volume" released by "delete_volume" :: held 2.350s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:48:29 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Lock "cinder-quobyte-a8c1a971-0e28-43d9-a6e4-2741f60837e3" acquired by "delete_snapshot" :: waited 0.044s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:48:29 devstack sudo[85916]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:29 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Acquiring lock "cinder-quobyte-c3b69cdd-36db-4043-9f2f-13949914995b" by "_delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:48:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0fd18166-62a5-4089-9af5-9956fd26bc75 tempest-VolumesListAdminTestJSON-1436920875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.729s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:29 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-0fd18166-62a5-4089-9af5-9956fd26bc75 tempest-VolumesListAdminTestJSON-1436920875 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:48:29 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-0fd18166-62a5-4089-9af5-9956fd26bc75 tempest-VolumesListAdminTestJSON-1436920875 None] Deleted volume successfully. Apr 24 13:48:29 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Lock "cinder-quobyte-c3b69cdd-36db-4043-9f2f-13949914995b" acquired by "_delete_snapshot" :: waited 0.093s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:48:29 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Deleting offline snapshot c3b69cdd-36db-4043-9f2f-13949914995b of volume a8c1a971-0e28-43d9-a6e4-2741f60837e3 {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 13:48:29 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] snapshot_file for this snap is: volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.c3b69cdd-36db-4043-9f2f-13949914995b {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 13:48:29 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-c008da5f-2caa-4cff-80b1-a4b37dcc4e56 tempest-VolumesListAdminTestJSON-277972602 None] Acquiring lock "cinder-132ab4df-aad8-4b1c-8bea-8e0559e92153-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:48:29 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-0fd18166-62a5-4089-9af5-9956fd26bc75 tempest-VolumesListAdminTestJSON-1436920875 None] Lock "cinder-a7cb3b42-bb4b-4cb0-ad30-6fa361c6bf7c-delete_volume" released by "delete_volume" :: held 2.753s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:48:29 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[17cff9e6-b7eb-40ed-90c3-14e8739c62fd]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:48:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.c3b69cdd-36db-4043-9f2f-13949914995b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:29 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-c008da5f-2caa-4cff-80b1-a4b37dcc4e56 tempest-VolumesListAdminTestJSON-277972602 None] Lock "cinder-132ab4df-aad8-4b1c-8bea-8e0559e92153-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:48:29 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-c008da5f-2caa-4cff-80b1-a4b37dcc4e56 tempest-VolumesListAdminTestJSON-277972602 None] Acquiring lock "cinder-quobyte-132ab4df-aad8-4b1c-8bea-8e0559e92153" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:48:29 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-c008da5f-2caa-4cff-80b1-a4b37dcc4e56 tempest-VolumesListAdminTestJSON-277972602 None] Lock "cinder-quobyte-132ab4df-aad8-4b1c-8bea-8e0559e92153" acquired by "delete_volume" :: waited 0.038s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:48:29 devstack sudo[85933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.c3b69cdd-36db-4043-9f2f-13949914995b Apr 24 13:48:29 devstack sudo[85933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:29 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[4597f231-e078-4e59-b711-c5f391cafab9]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:48:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-c008da5f-2caa-4cff-80b1-a4b37dcc4e56 tempest-VolumesListAdminTestJSON-277972602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-132ab4df-aad8-4b1c-8bea-8e0559e92153 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:30 devstack sudo[85936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-132ab4df-aad8-4b1c-8bea-8e0559e92153 Apr 24 13:48:30 devstack sudo[85936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:30 devstack sudo[85928]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d26b0118-5fc6-4a7f-8637-286b00f3e17d tempest-VolumeRetypeWithoutMigrationTest-439811691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7a62c778-9f9b-4497-8542-c907e50bb429" returned: 0 in 0.628s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:30 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-d26b0118-5fc6-4a7f-8637-286b00f3e17d tempest-VolumeRetypeWithoutMigrationTest-439811691 None] <== create_volume: return (1377ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:48:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d26b0118-5fc6-4a7f-8637-286b00f3e17d tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.380s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:48:30 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d26b0118-5fc6-4a7f-8637-286b00f3e17d tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21b5b982-6d24-49bd-9469-3c1b0d908dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a62c778-9f9b-4497-8542-c907e50bb429', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:30 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d26b0118-5fc6-4a7f-8637-286b00f3e17d tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c80ad979-7214-4e24-905c-e9dfa21cb7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:30 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-d26b0118-5fc6-4a7f-8637-286b00f3e17d tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Volume volume-7a62c778-9f9b-4497-8542-c907e50bb429 (7a62c778-9f9b-4497-8542-c907e50bb429): created successfully Apr 24 13:48:30 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d26b0118-5fc6-4a7f-8637-286b00f3e17d tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c80ad979-7214-4e24-905c-e9dfa21cb7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:30 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d26b0118-5fc6-4a7f-8637-286b00f3e17d tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Flow 'volume_create_manager' (5cdf76f3-2dd7-4030-99ea-e682118a67e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:48:30 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-d26b0118-5fc6-4a7f-8637-286b00f3e17d tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Created volume successfully. Apr 24 13:48:30 devstack sudo[85936]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-c008da5f-2caa-4cff-80b1-a4b37dcc4e56 tempest-VolumesListAdminTestJSON-277972602 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-132ab4df-aad8-4b1c-8bea-8e0559e92153" returned: 0 in 0.588s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-c008da5f-2caa-4cff-80b1-a4b37dcc4e56 tempest-VolumesListAdminTestJSON-277972602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-132ab4df-aad8-4b1c-8bea-8e0559e92153 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:30 devstack sudo[85951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-132ab4df-aad8-4b1c-8bea-8e0559e92153 Apr 24 13:48:30 devstack sudo[85951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:30 devstack sudo[85933]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.c3b69cdd-36db-4043-9f2f-13949914995b" returned: 0 in 0.788s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:30 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:48:30 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[621a1ee3-5e55-45af-8979-82d253b69273]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:48:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:30 devstack sudo[85953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3 Apr 24 13:48:30 devstack sudo[85953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:31 devstack sudo[85951]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-c008da5f-2caa-4cff-80b1-a4b37dcc4e56 tempest-VolumesListAdminTestJSON-277972602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-132ab4df-aad8-4b1c-8bea-8e0559e92153" returned: 0 in 0.929s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:31 devstack sudo[85953]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:31 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-c008da5f-2caa-4cff-80b1-a4b37dcc4e56 tempest-VolumesListAdminTestJSON-277972602 None] Lock "cinder-quobyte-132ab4df-aad8-4b1c-8bea-8e0559e92153" released by "delete_volume" :: held 1.578s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:48:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3" returned: 0 in 0.912s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.c3b69cdd-36db-4043-9f2f-13949914995b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:31 devstack sudo[85978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.c3b69cdd-36db-4043-9f2f-13949914995b Apr 24 13:48:31 devstack sudo[85978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-08332eed-6a43-4268-80b2-3a2b537f5593 tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:48:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-08332eed-6a43-4268-80b2-3a2b537f5593 tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:48:31 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-08332eed-6a43-4268-80b2-3a2b537f5593 tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:48:31 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-08332eed-6a43-4268-80b2-3a2b537f5593 tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:48:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-08332eed-6a43-4268-80b2-3a2b537f5593 tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:48:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-08332eed-6a43-4268-80b2-3a2b537f5593 tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:31 devstack sudo[85983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:48:31 devstack sudo[85983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:31 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-c008da5f-2caa-4cff-80b1-a4b37dcc4e56 tempest-VolumesListAdminTestJSON-277972602 None] Created reservations ['57f46ae0-8e98-42a1-847b-f14ecfba1a82', '5fc683bd-2dbd-4333-ad00-16dff6ce0c2d', 'd233ad50-1cf9-4d75-b56c-0331ccaa0d89', '82944603-91c5-45d2-9c94-1f0d0cdd42e5'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:48:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-c008da5f-2caa-4cff-80b1-a4b37dcc4e56 tempest-VolumesListAdminTestJSON-277972602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:48:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-c008da5f-2caa-4cff-80b1-a4b37dcc4e56 tempest-VolumesListAdminTestJSON-277972602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:48:31 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-c008da5f-2caa-4cff-80b1-a4b37dcc4e56 tempest-VolumesListAdminTestJSON-277972602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:48:31 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-c008da5f-2caa-4cff-80b1-a4b37dcc4e56 tempest-VolumesListAdminTestJSON-277972602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:48:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-c008da5f-2caa-4cff-80b1-a4b37dcc4e56 tempest-VolumesListAdminTestJSON-277972602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:48:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-c008da5f-2caa-4cff-80b1-a4b37dcc4e56 tempest-VolumesListAdminTestJSON-277972602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:31 devstack sudo[85996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:48:31 devstack sudo[85996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:32 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-a7b76183-64c7-439f-8e27-12d823590bd5 tempest-VolumesListAdminTestJSON-277972602 None] Acquiring lock "cinder-da74171e-1312-498c-b7e1-4fa32691f232-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:48:32 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-a7b76183-64c7-439f-8e27-12d823590bd5 tempest-VolumesListAdminTestJSON-277972602 None] Lock "cinder-da74171e-1312-498c-b7e1-4fa32691f232-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:48:32 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-a7b76183-64c7-439f-8e27-12d823590bd5 tempest-VolumesListAdminTestJSON-277972602 None] Acquiring lock "cinder-quobyte-da74171e-1312-498c-b7e1-4fa32691f232" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:48:32 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-a7b76183-64c7-439f-8e27-12d823590bd5 tempest-VolumesListAdminTestJSON-277972602 None] Lock "cinder-quobyte-da74171e-1312-498c-b7e1-4fa32691f232" acquired by "delete_volume" :: waited 0.037s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:48:32 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c25a70-689e-4850-8aca-680f765cf611]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:48:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a7b76183-64c7-439f-8e27-12d823590bd5 tempest-VolumesListAdminTestJSON-277972602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-da74171e-1312-498c-b7e1-4fa32691f232 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:32 devstack sudo[85978]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.c3b69cdd-36db-4043-9f2f-13949914995b" returned: 0 in 1.113s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.c3b69cdd-36db-4043-9f2f-13949914995b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:32 devstack sudo[86006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.c3b69cdd-36db-4043-9f2f-13949914995b Apr 24 13:48:32 devstack sudo[86006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:32 devstack sudo[86004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-da74171e-1312-498c-b7e1-4fa32691f232 Apr 24 13:48:32 devstack sudo[86004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:32 devstack sudo[85983]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-08332eed-6a43-4268-80b2-3a2b537f5593 tempest-VolumeRetypeWithoutMigrationTest-439811691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 1.316s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:32 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-08332eed-6a43-4268-80b2-3a2b537f5593 tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:48:32 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-08332eed-6a43-4268-80b2-3a2b537f5593 tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Retype volume completed successfully. Apr 24 13:48:32 devstack sudo[85996]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-c008da5f-2caa-4cff-80b1-a4b37dcc4e56 tempest-VolumesListAdminTestJSON-277972602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 1.100s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:32 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-c008da5f-2caa-4cff-80b1-a4b37dcc4e56 tempest-VolumesListAdminTestJSON-277972602 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:48:32 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-69effabb-0a15-4c4f-b043-6b59c7ce2e56 tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Acquiring lock "cinder-7a62c778-9f9b-4497-8542-c907e50bb429-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:48:32 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-c008da5f-2caa-4cff-80b1-a4b37dcc4e56 tempest-VolumesListAdminTestJSON-277972602 None] Deleted volume successfully. Apr 24 13:48:33 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-69effabb-0a15-4c4f-b043-6b59c7ce2e56 tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Lock "cinder-7a62c778-9f9b-4497-8542-c907e50bb429-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:48:33 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-c008da5f-2caa-4cff-80b1-a4b37dcc4e56 tempest-VolumesListAdminTestJSON-277972602 None] Lock "cinder-132ab4df-aad8-4b1c-8bea-8e0559e92153-delete_volume" released by "delete_volume" :: held 3.280s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:48:33 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-69effabb-0a15-4c4f-b043-6b59c7ce2e56 tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Acquiring lock "cinder-quobyte-7a62c778-9f9b-4497-8542-c907e50bb429" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:48:33 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-69effabb-0a15-4c4f-b043-6b59c7ce2e56 tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Lock "cinder-quobyte-7a62c778-9f9b-4497-8542-c907e50bb429" acquired by "delete_volume" :: waited 0.034s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:48:33 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[613c0a06-99eb-4d01-8223-3db1b6d7d6dc]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:48:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-69effabb-0a15-4c4f-b043-6b59c7ce2e56 tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7a62c778-9f9b-4497-8542-c907e50bb429 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:33 devstack sudo[86011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7a62c778-9f9b-4497-8542-c907e50bb429 Apr 24 13:48:33 devstack sudo[86011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:33 devstack sudo[86006]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3.c3b69cdd-36db-4043-9f2f-13949914995b" returned: 0 in 0.988s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:33 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Lock "cinder-quobyte-c3b69cdd-36db-4043-9f2f-13949914995b" released by "_delete_snapshot" :: held 3.955s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:48:33 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Lock "cinder-quobyte-a8c1a971-0e28-43d9-a6e4-2741f60837e3" released by "delete_snapshot" :: held 4.066s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:48:33 devstack sudo[86004]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a7b76183-64c7-439f-8e27-12d823590bd5 tempest-VolumesListAdminTestJSON-277972602 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-da74171e-1312-498c-b7e1-4fa32691f232" returned: 0 in 1.216s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a7b76183-64c7-439f-8e27-12d823590bd5 tempest-VolumesListAdminTestJSON-277972602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-da74171e-1312-498c-b7e1-4fa32691f232 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:33 devstack sudo[86018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-da74171e-1312-498c-b7e1-4fa32691f232 Apr 24 13:48:33 devstack sudo[86018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:33 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Created reservations ['6552bbf5-4c41-4961-b31b-b12e2a60a248', 'ab39a04c-6146-4728-8467-6e80bafb3a74', '910940de-89bf-486c-9918-628a68dffa7c', 'bf9a491e-cff8-4b26-995e-d90d0e3feda3'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:48:33 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Delete snapshot completed successfully. Apr 24 13:48:33 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Lock "cinder-c3b69cdd-36db-4043-9f2f-13949914995b-delete_snapshot" released by "delete_snapshot" :: held 4.414s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:48:33 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Snapshots deleted, issuing volume delete {{(pid=82046) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 24 13:48:33 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Acquiring lock "cinder-quobyte-a8c1a971-0e28-43d9-a6e4-2741f60837e3" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:48:33 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Lock "cinder-quobyte-a8c1a971-0e28-43d9-a6e4-2741f60837e3" acquired by "delete_volume" :: waited 0.028s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:48:33 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[d784c7cb-e8e6-4e2d-9384-d54ec3805052]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:48:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:34 devstack sudo[86021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3 Apr 24 13:48:34 devstack sudo[86021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:34 devstack sudo[86011]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-69effabb-0a15-4c4f-b043-6b59c7ce2e56 tempest-VolumeRetypeWithoutMigrationTest-439811691 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7a62c778-9f9b-4497-8542-c907e50bb429" returned: 0 in 1.023s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-69effabb-0a15-4c4f-b043-6b59c7ce2e56 tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7a62c778-9f9b-4497-8542-c907e50bb429 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:34 devstack sudo[86026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7a62c778-9f9b-4497-8542-c907e50bb429 Apr 24 13:48:34 devstack sudo[86026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:34 devstack sudo[86018]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a7b76183-64c7-439f-8e27-12d823590bd5 tempest-VolumesListAdminTestJSON-277972602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-da74171e-1312-498c-b7e1-4fa32691f232" returned: 0 in 1.141s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:34 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-a7b76183-64c7-439f-8e27-12d823590bd5 tempest-VolumesListAdminTestJSON-277972602 None] Lock "cinder-quobyte-da74171e-1312-498c-b7e1-4fa32691f232" released by "delete_volume" :: held 2.449s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:48:35 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-a7b76183-64c7-439f-8e27-12d823590bd5 tempest-VolumesListAdminTestJSON-277972602 None] Created reservations ['bb8009bc-c583-49e9-9edf-39b7b91576a4', 'af65de0d-6d97-479f-8439-f0df4b40e366', 'edecd0b7-ec49-4f53-bb9d-c5b6542d6b46', '07e9f325-2cae-422f-9010-6cc96dd2509b'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:48:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a7b76183-64c7-439f-8e27-12d823590bd5 tempest-VolumesListAdminTestJSON-277972602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:48:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a7b76183-64c7-439f-8e27-12d823590bd5 tempest-VolumesListAdminTestJSON-277972602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:48:35 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a7b76183-64c7-439f-8e27-12d823590bd5 tempest-VolumesListAdminTestJSON-277972602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:48:35 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a7b76183-64c7-439f-8e27-12d823590bd5 tempest-VolumesListAdminTestJSON-277972602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:48:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a7b76183-64c7-439f-8e27-12d823590bd5 tempest-VolumesListAdminTestJSON-277972602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:48:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a7b76183-64c7-439f-8e27-12d823590bd5 tempest-VolumesListAdminTestJSON-277972602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:35 devstack sudo[86042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:48:35 devstack sudo[86042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:35 devstack sudo[86021]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3" returned: 0 in 1.586s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:35 devstack sudo[86048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3 Apr 24 13:48:35 devstack sudo[86048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:35 devstack sudo[86026]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-69effabb-0a15-4c4f-b043-6b59c7ce2e56 tempest-VolumeRetypeWithoutMigrationTest-439811691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7a62c778-9f9b-4497-8542-c907e50bb429" returned: 0 in 1.649s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:35 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-69effabb-0a15-4c4f-b043-6b59c7ce2e56 tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Lock "cinder-quobyte-7a62c778-9f9b-4497-8542-c907e50bb429" released by "delete_volume" :: held 2.761s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:48:35 devstack cinder-volume[82046]: DEBUG dbcounter [-] [82046] Writing DB stats cinder:SELECT=105,cinder:UPDATE=122,cinder:DELETE=12,cinder:INSERT=33 {{(pid=82046) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 13:48:36 devstack cinder-volume[82046]: DEBUG dbcounter [-] [82046] Writing DB stats cinder:UPDATE=118,cinder:SELECT=121,cinder:INSERT=33,cinder:DELETE=5 {{(pid=82046) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 13:48:36 devstack cinder-volume[82046]: WARNING cinder.quota [None req-69effabb-0a15-4c4f-b043-6b59c7ce2e56 tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 24 13:48:36 devstack cinder-volume[82046]: WARNING cinder.quota [None req-69effabb-0a15-4c4f-b043-6b59c7ce2e56 tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 24 13:48:36 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-69effabb-0a15-4c4f-b043-6b59c7ce2e56 tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Created reservations ['24afaa33-26fe-47e5-8970-6a907a254923', '8f04bb08-cb71-4be5-8a9c-6c20579066db', '2fee8641-0c1a-42a4-bdb9-8b57c6c7383c', '2249a0bc-db85-4d4a-9dc5-c0c25f6c8843'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:48:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-69effabb-0a15-4c4f-b043-6b59c7ce2e56 tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:48:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-69effabb-0a15-4c4f-b043-6b59c7ce2e56 tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:48:36 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-69effabb-0a15-4c4f-b043-6b59c7ce2e56 tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:48:36 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-69effabb-0a15-4c4f-b043-6b59c7ce2e56 tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:48:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-69effabb-0a15-4c4f-b043-6b59c7ce2e56 tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:48:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-69effabb-0a15-4c4f-b043-6b59c7ce2e56 tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:36 devstack sudo[86053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:48:36 devstack sudo[86053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:36 devstack sudo[86042]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a7b76183-64c7-439f-8e27-12d823590bd5 tempest-VolumesListAdminTestJSON-277972602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 1.545s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:36 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-a7b76183-64c7-439f-8e27-12d823590bd5 tempest-VolumesListAdminTestJSON-277972602 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:48:36 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-a7b76183-64c7-439f-8e27-12d823590bd5 tempest-VolumesListAdminTestJSON-277972602 None] Deleted volume successfully. Apr 24 13:48:36 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-a7b76183-64c7-439f-8e27-12d823590bd5 tempest-VolumesListAdminTestJSON-277972602 None] Lock "cinder-da74171e-1312-498c-b7e1-4fa32691f232-delete_volume" released by "delete_volume" :: held 4.510s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:48:36 devstack sudo[86048]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a8c1a971-0e28-43d9-a6e4-2741f60837e3" returned: 0 in 1.351s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:36 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Lock "cinder-quobyte-a8c1a971-0e28-43d9-a6e4-2741f60837e3" released by "delete_volume" :: held 3.017s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:48:37 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Created reservations ['7c8ae73f-064b-4a26-a457-7c718d24f94f', '4fe64a2f-9300-4086-b006-a5ae4caf440a', '4057b40f-3ed9-4c48-8b23-210fd00cea11', '7fb91229-1e69-41b1-ad80-8849b35ddc1f'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:48:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:48:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:48:37 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:48:37 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:48:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:48:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:37 devstack sudo[86055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:48:37 devstack sudo[86055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:37 devstack sudo[86053]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-69effabb-0a15-4c4f-b043-6b59c7ce2e56 tempest-VolumeRetypeWithoutMigrationTest-439811691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.938s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:37 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-69effabb-0a15-4c4f-b043-6b59c7ce2e56 tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:48:37 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-69effabb-0a15-4c4f-b043-6b59c7ce2e56 tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Deleted volume successfully. Apr 24 13:48:37 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-69effabb-0a15-4c4f-b043-6b59c7ce2e56 tempest-VolumeRetypeWithoutMigrationTest-439811691 None] Lock "cinder-7a62c778-9f9b-4497-8542-c907e50bb429-delete_volume" released by "delete_volume" :: held 4.467s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:48:37 devstack cinder-volume[82046]: DEBUG oslo_service.periodic_task [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82046) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 13:48:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:48:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:48:37 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:48:37 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:48:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:48:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:37 devstack sudo[86059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:48:37 devstack sudo[86059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:38 devstack sudo[86055]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 1.380s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:38 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:48:38 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Deleted volume successfully. Apr 24 13:48:38 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ac20adad-4416-4e72-857e-9749e25496f4 tempest-VolumesDeleteCascade-2142546263 None] Lock "cinder-a8c1a971-0e28-43d9-a6e4-2741f60837e3-delete_volume" released by "delete_volume" :: held 16.149s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:48:39 devstack sudo[86059]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:39 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-322a76f6-1be0-453e-98e6-1a6321c4fda6 tempest-VolumesDeleteCascade-2142546263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:48:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-322a76f6-1be0-453e-98e6-1a6321c4fda6 tempest-VolumesDeleteCascade-2142546263 None] Flow 'volume_create_manager' (4f49ee15-2b25-4881-96cd-7bb847add03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:48:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-322a76f6-1be0-453e-98e6-1a6321c4fda6 tempest-VolumesDeleteCascade-2142546263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6594860f-2fa9-4bec-9a8a-e60a48c4eaf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 1.209s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:39 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:48:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-322a76f6-1be0-453e-98e6-1a6321c4fda6 tempest-VolumesDeleteCascade-2142546263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6594860f-2fa9-4bec-9a8a-e60a48c4eaf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:48:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-383255806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc0c26e7-4682-4485-9068-b2fbb82b60e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f96a8076471449f4b83361e0131fc98b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:48:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:48:39Z,use_quota=True,user_id='b2c6b73e64fe4522899835af23694731',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-322a76f6-1be0-453e-98e6-1a6321c4fda6 tempest-VolumesDeleteCascade-2142546263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4512ad0-2822-4e86-8ec5-772ab0881e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-322a76f6-1be0-453e-98e6-1a6321c4fda6 tempest-VolumesDeleteCascade-2142546263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4512ad0-2822-4e86-8ec5-772ab0881e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-322a76f6-1be0-453e-98e6-1a6321c4fda6 tempest-VolumesDeleteCascade-2142546263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b4e00db-8178-4a8c-af6b-477b53cb6c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-322a76f6-1be0-453e-98e6-1a6321c4fda6 tempest-VolumesDeleteCascade-2142546263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b4e00db-8178-4a8c-af6b-477b53cb6c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc0c26e7-4682-4485-9068-b2fbb82b60e8', 'volume_name': 'volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-322a76f6-1be0-453e-98e6-1a6321c4fda6 tempest-VolumesDeleteCascade-2142546263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d72547a2-dc79-4acb-a3a4-49faaf30dbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-322a76f6-1be0-453e-98e6-1a6321c4fda6 tempest-VolumesDeleteCascade-2142546263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d72547a2-dc79-4acb-a3a4-49faaf30dbcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-322a76f6-1be0-453e-98e6-1a6321c4fda6 tempest-VolumesDeleteCascade-2142546263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bef54ac-5cb0-41ee-aa12-3d01e9e8df93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:39 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-322a76f6-1be0-453e-98e6-1a6321c4fda6 tempest-VolumesDeleteCascade-2142546263 None] Volume cc0c26e7-4682-4485-9068-b2fbb82b60e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8', 'volume_size': 1} Apr 24 13:48:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-322a76f6-1be0-453e-98e6-1a6321c4fda6 tempest-VolumesDeleteCascade-2142546263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:48:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-322a76f6-1be0-453e-98e6-1a6321c4fda6 tempest-VolumesDeleteCascade-2142546263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:48:39 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-322a76f6-1be0-453e-98e6-1a6321c4fda6 tempest-VolumesDeleteCascade-2142546263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:48:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-383255806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc0c26e7-4682-4485-9068-b2fbb82b60e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f96a8076471449f4b83361e0131fc98b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:48:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:48:39Z,use_quota=True,user_id='b2c6b73e64fe4522899835af23694731',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:48:39 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-322a76f6-1be0-453e-98e6-1a6321c4fda6 tempest-VolumesDeleteCascade-2142546263 None] Creating volume cc0c26e7-4682-4485-9068-b2fbb82b60e8 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:48:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-322a76f6-1be0-453e-98e6-1a6321c4fda6 tempest-VolumesDeleteCascade-2142546263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:48:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-322a76f6-1be0-453e-98e6-1a6321c4fda6 tempest-VolumesDeleteCascade-2142546263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:48:39 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-322a76f6-1be0-453e-98e6-1a6321c4fda6 tempest-VolumesDeleteCascade-2142546263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:48:39 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-322a76f6-1be0-453e-98e6-1a6321c4fda6 tempest-VolumesDeleteCascade-2142546263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:48:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-322a76f6-1be0-453e-98e6-1a6321c4fda6 tempest-VolumesDeleteCascade-2142546263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:48:39 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-322a76f6-1be0-453e-98e6-1a6321c4fda6 tempest-VolumesDeleteCascade-2142546263 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:48:39 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-322a76f6-1be0-453e-98e6-1a6321c4fda6 tempest-VolumesDeleteCascade-2142546263 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:48:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-322a76f6-1be0-453e-98e6-1a6321c4fda6 tempest-VolumesDeleteCascade-2142546263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:39 devstack sudo[86063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8 1073741824 Apr 24 13:48:39 devstack sudo[86063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:40 devstack sudo[86063]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:40 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-322a76f6-1be0-453e-98e6-1a6321c4fda6 tempest-VolumesDeleteCascade-2142546263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8 1073741824" returned: 0 in 1.129s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:40 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-322a76f6-1be0-453e-98e6-1a6321c4fda6 tempest-VolumesDeleteCascade-2142546263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:40 devstack sudo[86068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8 Apr 24 13:48:40 devstack sudo[86068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:41 devstack sudo[86068]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-322a76f6-1be0-453e-98e6-1a6321c4fda6 tempest-VolumesDeleteCascade-2142546263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8" returned: 0 in 1.170s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:41 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-322a76f6-1be0-453e-98e6-1a6321c4fda6 tempest-VolumesDeleteCascade-2142546263 None] <== create_volume: return (2393ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:48:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-322a76f6-1be0-453e-98e6-1a6321c4fda6 tempest-VolumesDeleteCascade-2142546263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.396s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:48:41 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-322a76f6-1be0-453e-98e6-1a6321c4fda6 tempest-VolumesDeleteCascade-2142546263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bef54ac-5cb0-41ee-aa12-3d01e9e8df93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:41 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-322a76f6-1be0-453e-98e6-1a6321c4fda6 tempest-VolumesDeleteCascade-2142546263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc196447-d8e1-4dbb-bd89-adf22c70e604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:41 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-322a76f6-1be0-453e-98e6-1a6321c4fda6 tempest-VolumesDeleteCascade-2142546263 None] Volume volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8 (cc0c26e7-4682-4485-9068-b2fbb82b60e8): created successfully Apr 24 13:48:41 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-322a76f6-1be0-453e-98e6-1a6321c4fda6 tempest-VolumesDeleteCascade-2142546263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc196447-d8e1-4dbb-bd89-adf22c70e604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:41 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-322a76f6-1be0-453e-98e6-1a6321c4fda6 tempest-VolumesDeleteCascade-2142546263 None] Flow 'volume_create_manager' (4f49ee15-2b25-4881-96cd-7bb847add03f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:48:41 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-322a76f6-1be0-453e-98e6-1a6321c4fda6 tempest-VolumesDeleteCascade-2142546263 None] Created volume successfully. Apr 24 13:48:42 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b94132d6-f3fc-4a76-a3c5-a4f78e985ddf tempest-VolumesDeleteCascade-2142546263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:48:42 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b94132d6-f3fc-4a76-a3c5-a4f78e985ddf tempest-VolumesDeleteCascade-2142546263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:48:42 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-b94132d6-f3fc-4a76-a3c5-a4f78e985ddf tempest-VolumesDeleteCascade-2142546263 None] Creating offline snapshot c9b5611f-caba-4f12-8605-780ba62610f4 of volume cc0c26e7-4682-4485-9068-b2fbb82b60e8 {{(pid=82046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 13:48:42 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6dd25e2-c687-4a1f-a7ac-cc878ccb3770]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:48:42 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b94132d6-f3fc-4a76-a3c5-a4f78e985ddf tempest-VolumesDeleteCascade-2142546263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:42 devstack sudo[86071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8 Apr 24 13:48:42 devstack sudo[86071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:43 devstack sudo[86071]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b94132d6-f3fc-4a76-a3c5-a4f78e985ddf tempest-VolumesDeleteCascade-2142546263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8" returned: 0 in 0.923s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b94132d6-f3fc-4a76-a3c5-a4f78e985ddf tempest-VolumesDeleteCascade-2142546263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8.c9b5611f-caba-4f12-8605-780ba62610f4 1G {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:43 devstack sudo[86086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8.c9b5611f-caba-4f12-8605-780ba62610f4 1G Apr 24 13:48:43 devstack sudo[86086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:44 devstack sudo[86086]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b94132d6-f3fc-4a76-a3c5-a4f78e985ddf tempest-VolumesDeleteCascade-2142546263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8.c9b5611f-caba-4f12-8605-780ba62610f4 1G" returned: 0 in 1.123s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b94132d6-f3fc-4a76-a3c5-a4f78e985ddf tempest-VolumesDeleteCascade-2142546263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8.c9b5611f-caba-4f12-8605-780ba62610f4 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:44 devstack sudo[86111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8.c9b5611f-caba-4f12-8605-780ba62610f4 Apr 24 13:48:44 devstack sudo[86111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:45 devstack sudo[86111]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b94132d6-f3fc-4a76-a3c5-a4f78e985ddf tempest-VolumesDeleteCascade-2142546263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8.c9b5611f-caba-4f12-8605-780ba62610f4" returned: 0 in 0.859s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:45 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-b94132d6-f3fc-4a76-a3c5-a4f78e985ddf tempest-VolumesDeleteCascade-2142546263 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8.c9b5611f-caba-4f12-8605-780ba62610f4 is being set with open permissions: ugo+rw Apr 24 13:48:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b94132d6-f3fc-4a76-a3c5-a4f78e985ddf tempest-VolumesDeleteCascade-2142546263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8.c9b5611f-caba-4f12-8605-780ba62610f4 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:45 devstack sudo[86117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8.c9b5611f-caba-4f12-8605-780ba62610f4 Apr 24 13:48:45 devstack sudo[86117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:46 devstack sudo[86117]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:46 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b94132d6-f3fc-4a76-a3c5-a4f78e985ddf tempest-VolumesDeleteCascade-2142546263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8.c9b5611f-caba-4f12-8605-780ba62610f4" returned: 0 in 0.652s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:46 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b94132d6-f3fc-4a76-a3c5-a4f78e985ddf tempest-VolumesDeleteCascade-2142546263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:46 devstack sudo[86133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8.info Apr 24 13:48:46 devstack sudo[86133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:46 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f8f18bc-4da4-45d2-9609-03f5caffd457 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:48:46 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8f8f18bc-4da4-45d2-9609-03f5caffd457 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Flow 'volume_create_manager' (420b12a4-9388-45c7-ab08-408c42ae872a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:48:46 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8f8f18bc-4da4-45d2-9609-03f5caffd457 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d121684-eee9-490b-a29b-91efa4009c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:46 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8f8f18bc-4da4-45d2-9609-03f5caffd457 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d121684-eee9-490b-a29b-91efa4009c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-327545387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bbd6a98-6aee-43a7-9f64-f8e7643514ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51bd716730514a0f8dc5733ca160cbb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:48:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:48:46Z,use_quota=True,user_id='abdf48defe3849a0aecb42b77b13019b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:46 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8f8f18bc-4da4-45d2-9609-03f5caffd457 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f0982f7-694b-4f57-a2b9-b12123d3dba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:46 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8f8f18bc-4da4-45d2-9609-03f5caffd457 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f0982f7-694b-4f57-a2b9-b12123d3dba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:46 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8f8f18bc-4da4-45d2-9609-03f5caffd457 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (222bf0b6-5e76-43f8-8488-21189ae7d991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:46 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8f8f18bc-4da4-45d2-9609-03f5caffd457 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (222bf0b6-5e76-43f8-8488-21189ae7d991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bbd6a98-6aee-43a7-9f64-f8e7643514ca', 'volume_name': 'volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:46 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8f8f18bc-4da4-45d2-9609-03f5caffd457 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb1daf9e-18f3-40b1-bea4-b48271195e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:46 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8f8f18bc-4da4-45d2-9609-03f5caffd457 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb1daf9e-18f3-40b1-bea4-b48271195e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:46 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8f8f18bc-4da4-45d2-9609-03f5caffd457 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d45980d-4808-4e63-96d8-c64d12011af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:46 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-8f8f18bc-4da4-45d2-9609-03f5caffd457 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Volume 9bbd6a98-6aee-43a7-9f64-f8e7643514ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca', 'volume_size': 1} Apr 24 13:48:46 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-8f8f18bc-4da4-45d2-9609-03f5caffd457 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:48:47 devstack sudo[86133]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b94132d6-f3fc-4a76-a3c5-a4f78e985ddf tempest-VolumesDeleteCascade-2142546263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8.info" returned: 0 in 0.626s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:47 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-b94132d6-f3fc-4a76-a3c5-a4f78e985ddf tempest-VolumesDeleteCascade-2142546263 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8.info is being set with open permissions: ugo+rw Apr 24 13:48:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b94132d6-f3fc-4a76-a3c5-a4f78e985ddf tempest-VolumesDeleteCascade-2142546263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:47 devstack sudo[86141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8.info Apr 24 13:48:47 devstack sudo[86141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:47 devstack sudo[86141]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b94132d6-f3fc-4a76-a3c5-a4f78e985ddf tempest-VolumesDeleteCascade-2142546263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8.info" returned: 0 in 0.525s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b94132d6-f3fc-4a76-a3c5-a4f78e985ddf tempest-VolumesDeleteCascade-2142546263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.852s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:48:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-8f8f18bc-4da4-45d2-9609-03f5caffd457 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.939s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:48:47 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-8f8f18bc-4da4-45d2-9609-03f5caffd457 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-327545387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bbd6a98-6aee-43a7-9f64-f8e7643514ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51bd716730514a0f8dc5733ca160cbb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:48:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:48:46Z,use_quota=True,user_id='abdf48defe3849a0aecb42b77b13019b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:48:47 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-8f8f18bc-4da4-45d2-9609-03f5caffd457 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Creating volume 9bbd6a98-6aee-43a7-9f64-f8e7643514ca {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:48:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-8f8f18bc-4da4-45d2-9609-03f5caffd457 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:48:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-8f8f18bc-4da4-45d2-9609-03f5caffd457 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:48:47 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-8f8f18bc-4da4-45d2-9609-03f5caffd457 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:48:47 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-8f8f18bc-4da4-45d2-9609-03f5caffd457 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:48:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-8f8f18bc-4da4-45d2-9609-03f5caffd457 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:48:47 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-8f8f18bc-4da4-45d2-9609-03f5caffd457 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:48:47 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-8f8f18bc-4da4-45d2-9609-03f5caffd457 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:48:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8f8f18bc-4da4-45d2-9609-03f5caffd457 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:47 devstack sudo[86144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca 1073741824 Apr 24 13:48:47 devstack sudo[86144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:47 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-b94132d6-f3fc-4a76-a3c5-a4f78e985ddf tempest-VolumesDeleteCascade-2142546263 None] Create snapshot completed successfully Apr 24 13:48:48 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:48:48 devstack sudo[86144]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:48 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] Flow 'volume_create_manager' (2d908565-42ef-4f6d-a42b-551f7e974fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:48:48 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b49824cc-a44f-4b05-9b0d-8791725611d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8f8f18bc-4da4-45d2-9609-03f5caffd457 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca 1073741824" returned: 0 in 1.111s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:48 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b49824cc-a44f-4b05-9b0d-8791725611d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:48:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1071473418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41102cda-c856-4f95-bb66-cbe24635e048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f96a8076471449f4b83361e0131fc98b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:48:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c9b5611f-caba-4f12-8605-780ba62610f4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:48:49Z,use_quota=True,user_id='b2c6b73e64fe4522899835af23694731',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:48 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8159c0f8-38a4-4158-bff0-7e096f8f38b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:48 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8159c0f8-38a4-4158-bff0-7e096f8f38b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:48 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72f4c7fa-3cbf-48b6-95e8-8906ea4d1743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:48 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72f4c7fa-3cbf-48b6-95e8-8906ea4d1743) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '41102cda-c856-4f95-bb66-cbe24635e048', 'volume_name': 'volume-41102cda-c856-4f95-bb66-cbe24635e048', 'volume_size': 1, 'snapshot_id': 'c9b5611f-caba-4f12-8605-780ba62610f4'}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:48 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f293bc40-2f12-4748-a63a-8b630380476d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:48 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f293bc40-2f12-4748-a63a-8b630380476d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:48 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (211d9e0a-a9de-4a0e-8fc9-c9cc01d15c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:48 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] Volume 41102cda-c856-4f95-bb66-cbe24635e048: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-41102cda-c856-4f95-bb66-cbe24635e048', 'volume_size': 1, 'snapshot_id': 'c9b5611f-caba-4f12-8605-780ba62610f4'} Apr 24 13:48:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:48:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8f8f18bc-4da4-45d2-9609-03f5caffd457 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:48 devstack sudo[86150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca Apr 24 13:48:48 devstack sudo[86150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:49 devstack sudo[86150]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8f8f18bc-4da4-45d2-9609-03f5caffd457 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca" returned: 0 in 0.507s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:49 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-8f8f18bc-4da4-45d2-9609-03f5caffd457 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] <== create_volume: return (1708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:48:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-8f8f18bc-4da4-45d2-9609-03f5caffd457 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.712s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:48:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.524s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:48:49 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] Acquiring lock "cinder-quobyte-c9b5611f-caba-4f12-8605-780ba62610f4-41102cda-c856-4f95-bb66-cbe24635e048" by "_create_volume_from_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:48:49 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8f8f18bc-4da4-45d2-9609-03f5caffd457 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d45980d-4808-4e63-96d8-c64d12011af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:49 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8f8f18bc-4da4-45d2-9609-03f5caffd457 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a954c551-490f-4153-a68a-b90613796cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:49 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-8f8f18bc-4da4-45d2-9609-03f5caffd457 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Volume volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca (9bbd6a98-6aee-43a7-9f64-f8e7643514ca): created successfully Apr 24 13:48:49 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8f8f18bc-4da4-45d2-9609-03f5caffd457 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a954c551-490f-4153-a68a-b90613796cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:49 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8f8f18bc-4da4-45d2-9609-03f5caffd457 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Flow 'volume_create_manager' (420b12a4-9388-45c7-ab08-408c42ae872a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:48:49 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] Lock "cinder-quobyte-c9b5611f-caba-4f12-8605-780ba62610f4-41102cda-c856-4f95-bb66-cbe24635e048" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:48:49 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] Creating volume 41102cda-c856-4f95-bb66-cbe24635e048 from snapshot c9b5611f-caba-4f12-8605-780ba62610f4 {{(pid=82046) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 13:48:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:48:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:48:49 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:48:49 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:48:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:48:49 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:48:49 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] Acquiring lock "cinder-quobyte-41102cda-c856-4f95-bb66-cbe24635e048" by "_copy_volume_from_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:48:49 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-8f8f18bc-4da4-45d2-9609-03f5caffd457 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Created volume successfully. Apr 24 13:48:49 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] Lock "cinder-quobyte-41102cda-c856-4f95-bb66-cbe24635e048" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:48:49 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] snapshot: c9b5611f-caba-4f12-8605-780ba62610f4, volume: 41102cda-c856-4f95-bb66-cbe24635e048, {{(pid=82046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 13:48:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:48:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:48:49 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:48:49 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:48:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:48:49 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[034bb9c5-fca4-4c1b-a085-a641b8523425]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:48:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8.c9b5611f-caba-4f12-8605-780ba62610f4 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:49 devstack sudo[86161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8.c9b5611f-caba-4f12-8605-780ba62610f4 Apr 24 13:48:49 devstack sudo[86161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-7ac794ef-4e74-41d3-a7b2-4b4e0513e5ab tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:48:50 devstack sudo[86161]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8.c9b5611f-caba-4f12-8605-780ba62610f4" returned: 0 in 0.713s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:50 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:48:50 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8 {{(pid=82046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 13:48:50 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] Creating direct copy from snapshot {{(pid=82046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 13:48:50 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec0749b-d4a4-47f6-85f8-bf8b04a88039]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:48:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:50 devstack sudo[86166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8 Apr 24 13:48:50 devstack sudo[86166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:50 devstack sudo[86166]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8" returned: 0 in 0.691s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:50 devstack cinder-volume[82046]: DEBUG cinder.utils [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] Path /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-41102cda-c856-4f95-bb66-cbe24635e048 not found in is_blk_device check {{(pid=82046) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 13:48:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-41102cda-c856-4f95-bb66-cbe24635e048 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:50 devstack sudo[86176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-41102cda-c856-4f95-bb66-cbe24635e048 Apr 24 13:48:50 devstack sudo[86176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:51 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-769c3a35-c1f9-4558-9114-938848587773 tempest-AbsoluteLimitsTests-2090554133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:48:51 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-769c3a35-c1f9-4558-9114-938848587773 tempest-AbsoluteLimitsTests-2090554133 None] Flow 'volume_create_manager' (61d6e437-f487-42c2-a1ce-c4688527d1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:48:51 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-769c3a35-c1f9-4558-9114-938848587773 tempest-AbsoluteLimitsTests-2090554133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d91feac7-9670-4290-886f-124b60d01f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:51 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-769c3a35-c1f9-4558-9114-938848587773 tempest-AbsoluteLimitsTests-2090554133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d91feac7-9670-4290-886f-124b60d01f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:48:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2071884240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3e94698-637c-48ec-9ad0-bbc317f47e05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb0eac5d78384e6b9141253097a5ad0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:48:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:48:51Z,use_quota=True,user_id='62bc568ff3e6464ea19d25851da820ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:51 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-769c3a35-c1f9-4558-9114-938848587773 tempest-AbsoluteLimitsTests-2090554133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cc15d22-91a1-4d86-9c85-caf8dcac2da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:51 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-769c3a35-c1f9-4558-9114-938848587773 tempest-AbsoluteLimitsTests-2090554133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cc15d22-91a1-4d86-9c85-caf8dcac2da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:51 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-769c3a35-c1f9-4558-9114-938848587773 tempest-AbsoluteLimitsTests-2090554133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8fa6577-164a-4af4-996a-c9799e4f11a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:51 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-769c3a35-c1f9-4558-9114-938848587773 tempest-AbsoluteLimitsTests-2090554133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8fa6577-164a-4af4-996a-c9799e4f11a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3e94698-637c-48ec-9ad0-bbc317f47e05', 'volume_name': 'volume-c3e94698-637c-48ec-9ad0-bbc317f47e05', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:51 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-769c3a35-c1f9-4558-9114-938848587773 tempest-AbsoluteLimitsTests-2090554133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fd27b94-9c36-4b56-89dd-0ffe5fe505c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:51 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-769c3a35-c1f9-4558-9114-938848587773 tempest-AbsoluteLimitsTests-2090554133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fd27b94-9c36-4b56-89dd-0ffe5fe505c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:51 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-769c3a35-c1f9-4558-9114-938848587773 tempest-AbsoluteLimitsTests-2090554133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c242ac8f-900b-437c-a3af-93491c10b245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:51 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-769c3a35-c1f9-4558-9114-938848587773 tempest-AbsoluteLimitsTests-2090554133 None] Volume c3e94698-637c-48ec-9ad0-bbc317f47e05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3e94698-637c-48ec-9ad0-bbc317f47e05', 'volume_size': 1} Apr 24 13:48:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-769c3a35-c1f9-4558-9114-938848587773 tempest-AbsoluteLimitsTests-2090554133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:48:58 devstack sudo[86176]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-41102cda-c856-4f95-bb66-cbe24635e048" returned: 0 in 7.335s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:58 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[04bf888d-078e-494c-a5ca-60cf0ff446be]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:48:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:58 devstack sudo[86251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8 Apr 24 13:48:58 devstack sudo[86251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:59 devstack sudo[86251]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8" returned: 0 in 0.944s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:59 devstack cinder-volume[82046]: DEBUG cinder.image.image_utils [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] Image conversion details: src /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8, size 1024.00 MB, duration 7.34 sec, destination /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-41102cda-c856-4f95-bb66-cbe24635e048 {{(pid=82046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 13:48:59 devstack cinder-volume[82046]: INFO cinder.image.image_utils [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] Converted 1024.00 MB image at 139.58 MB/s Apr 24 13:48:59 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-41102cda-c856-4f95-bb66-cbe24635e048 is being set with open permissions: ugo+rw Apr 24 13:48:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-41102cda-c856-4f95-bb66-cbe24635e048 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:59 devstack sudo[86288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-41102cda-c856-4f95-bb66-cbe24635e048 Apr 24 13:48:59 devstack sudo[86288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:48:59 devstack sudo[86288]: pam_unix(sudo:session): session closed for user root Apr 24 13:48:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-41102cda-c856-4f95-bb66-cbe24635e048" returned: 0 in 0.485s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:48:59 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] Lock "cinder-quobyte-41102cda-c856-4f95-bb66-cbe24635e048" released by "_copy_volume_from_snapshot" :: held 10.357s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:48:59 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] Lock "cinder-quobyte-c9b5611f-caba-4f12-8605-780ba62610f4-41102cda-c856-4f95-bb66-cbe24635e048" released by "_create_volume_from_snapshot" :: held 10.417s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:48:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.456s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:48:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-7ac794ef-4e74-41d3-a7b2-4b4e0513e5ab tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.777s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:48:59 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-7ac794ef-4e74-41d3-a7b2-4b4e0513e5ab tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Creating offline snapshot 31aa7aef-4c8c-402e-b62b-44903973da7d of volume 9bbd6a98-6aee-43a7-9f64-f8e7643514ca {{(pid=82046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 13:48:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (211d9e0a-a9de-4a0e-8fc9-c9cc01d15c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41102cda-c856-4f95-bb66-cbe24635e048', 'volume_size': 1, 'snapshot_id': 'c9b5611f-caba-4f12-8605-780ba62610f4'}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd0e7b1e-7090-47e1-8ff4-5b08eb8b623a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:48:59 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4156e11-5dac-463c-b77d-0933060cb21f]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:48:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7ac794ef-4e74-41d3-a7b2-4b4e0513e5ab tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:48:59 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] Volume volume-41102cda-c856-4f95-bb66-cbe24635e048 (41102cda-c856-4f95-bb66-cbe24635e048): created successfully Apr 24 13:48:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd0e7b1e-7090-47e1-8ff4-5b08eb8b623a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:48:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] Flow 'volume_create_manager' (2d908565-42ef-4f6d-a42b-551f7e974fa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:48:59 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-30cf1011-262f-4e11-b80d-6a13973ba277 tempest-VolumesDeleteCascade-2142546263 None] Created volume successfully. Apr 24 13:48:59 devstack sudo[86296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca Apr 24 13:48:59 devstack sudo[86296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:00 devstack sudo[86296]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:00 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7ac794ef-4e74-41d3-a7b2-4b4e0513e5ab tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca" returned: 0 in 0.601s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:00 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7ac794ef-4e74-41d3-a7b2-4b4e0513e5ab tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca.31aa7aef-4c8c-402e-b62b-44903973da7d 1G {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:00 devstack sudo[86308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca.31aa7aef-4c8c-402e-b62b-44903973da7d 1G Apr 24 13:49:00 devstack sudo[86308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:01 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e023700e-757a-4a26-a96b-37a5fe3cb866 tempest-VolumesDeleteCascade-2142546263 None] Acquiring lock "cinder-cc0c26e7-4682-4485-9068-b2fbb82b60e8-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:49:01 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e023700e-757a-4a26-a96b-37a5fe3cb866 tempest-VolumesDeleteCascade-2142546263 None] Lock "cinder-cc0c26e7-4682-4485-9068-b2fbb82b60e8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:49:01 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e023700e-757a-4a26-a96b-37a5fe3cb866 tempest-VolumesDeleteCascade-2142546263 None] Performing cascade delete. {{(pid=82046) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 24 13:49:01 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e023700e-757a-4a26-a96b-37a5fe3cb866 tempest-VolumesDeleteCascade-2142546263 None] Acquiring lock "cinder-c9b5611f-caba-4f12-8605-780ba62610f4-delete_snapshot" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:49:01 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e023700e-757a-4a26-a96b-37a5fe3cb866 tempest-VolumesDeleteCascade-2142546263 None] Lock "cinder-c9b5611f-caba-4f12-8605-780ba62610f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:49:01 devstack sudo[86308]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:01 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e023700e-757a-4a26-a96b-37a5fe3cb866 tempest-VolumesDeleteCascade-2142546263 None] Acquiring lock "cinder-quobyte-cc0c26e7-4682-4485-9068-b2fbb82b60e8" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:49:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7ac794ef-4e74-41d3-a7b2-4b4e0513e5ab tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca.31aa7aef-4c8c-402e-b62b-44903973da7d 1G" returned: 0 in 0.980s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7ac794ef-4e74-41d3-a7b2-4b4e0513e5ab tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca.31aa7aef-4c8c-402e-b62b-44903973da7d {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:01 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e023700e-757a-4a26-a96b-37a5fe3cb866 tempest-VolumesDeleteCascade-2142546263 None] Lock "cinder-quobyte-cc0c26e7-4682-4485-9068-b2fbb82b60e8" acquired by "delete_snapshot" :: waited 0.041s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:49:01 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e023700e-757a-4a26-a96b-37a5fe3cb866 tempest-VolumesDeleteCascade-2142546263 None] Acquiring lock "cinder-quobyte-c9b5611f-caba-4f12-8605-780ba62610f4" by "_delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:49:01 devstack sudo[86341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca.31aa7aef-4c8c-402e-b62b-44903973da7d Apr 24 13:49:01 devstack sudo[86341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:01 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e023700e-757a-4a26-a96b-37a5fe3cb866 tempest-VolumesDeleteCascade-2142546263 None] Lock "cinder-quobyte-c9b5611f-caba-4f12-8605-780ba62610f4" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:49:01 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-e023700e-757a-4a26-a96b-37a5fe3cb866 tempest-VolumesDeleteCascade-2142546263 None] Deleting offline snapshot c9b5611f-caba-4f12-8605-780ba62610f4 of volume cc0c26e7-4682-4485-9068-b2fbb82b60e8 {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 13:49:01 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-e023700e-757a-4a26-a96b-37a5fe3cb866 tempest-VolumesDeleteCascade-2142546263 None] snapshot_file for this snap is: volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8.c9b5611f-caba-4f12-8605-780ba62610f4 {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 13:49:01 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[0934c718-fc83-4ae6-a8eb-debb5e5f7b0c]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:49:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e023700e-757a-4a26-a96b-37a5fe3cb866 tempest-VolumesDeleteCascade-2142546263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8.c9b5611f-caba-4f12-8605-780ba62610f4 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:01 devstack sudo[86346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8.c9b5611f-caba-4f12-8605-780ba62610f4 Apr 24 13:49:01 devstack sudo[86346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:02 devstack sudo[86346]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e023700e-757a-4a26-a96b-37a5fe3cb866 tempest-VolumesDeleteCascade-2142546263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8.c9b5611f-caba-4f12-8605-780ba62610f4" returned: 0 in 0.692s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:02 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-e023700e-757a-4a26-a96b-37a5fe3cb866 tempest-VolumesDeleteCascade-2142546263 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:49:02 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfaddd4c-79a7-418a-9a98-b7ecc23d3ea0]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:49:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e023700e-757a-4a26-a96b-37a5fe3cb866 tempest-VolumesDeleteCascade-2142546263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:02 devstack sudo[86341]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7ac794ef-4e74-41d3-a7b2-4b4e0513e5ab tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca.31aa7aef-4c8c-402e-b62b-44903973da7d" returned: 0 in 0.959s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:02 devstack sudo[86355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8 Apr 24 13:49:02 devstack sudo[86355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:02 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-7ac794ef-4e74-41d3-a7b2-4b4e0513e5ab tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca.31aa7aef-4c8c-402e-b62b-44903973da7d is being set with open permissions: ugo+rw Apr 24 13:49:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7ac794ef-4e74-41d3-a7b2-4b4e0513e5ab tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca.31aa7aef-4c8c-402e-b62b-44903973da7d {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:02 devstack sudo[86357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca.31aa7aef-4c8c-402e-b62b-44903973da7d Apr 24 13:49:02 devstack sudo[86357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:02 devstack sudo[86357]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7ac794ef-4e74-41d3-a7b2-4b4e0513e5ab tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca.31aa7aef-4c8c-402e-b62b-44903973da7d" returned: 0 in 0.523s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:02 devstack sudo[86355]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e023700e-757a-4a26-a96b-37a5fe3cb866 tempest-VolumesDeleteCascade-2142546263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8" returned: 0 in 0.636s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e023700e-757a-4a26-a96b-37a5fe3cb866 tempest-VolumesDeleteCascade-2142546263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8.c9b5611f-caba-4f12-8605-780ba62610f4 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7ac794ef-4e74-41d3-a7b2-4b4e0513e5ab tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:02 devstack sudo[86363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8.c9b5611f-caba-4f12-8605-780ba62610f4 Apr 24 13:49:02 devstack sudo[86363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:02 devstack sudo[86364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca.info Apr 24 13:49:02 devstack sudo[86364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:03 devstack sudo[86364]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7ac794ef-4e74-41d3-a7b2-4b4e0513e5ab tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca.info" returned: 0 in 0.664s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:03 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-7ac794ef-4e74-41d3-a7b2-4b4e0513e5ab tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca.info is being set with open permissions: ugo+rw Apr 24 13:49:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7ac794ef-4e74-41d3-a7b2-4b4e0513e5ab tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:03 devstack sudo[86373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca.info Apr 24 13:49:03 devstack sudo[86373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:03 devstack sudo[86363]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e023700e-757a-4a26-a96b-37a5fe3cb866 tempest-VolumesDeleteCascade-2142546263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8.c9b5611f-caba-4f12-8605-780ba62610f4" returned: 0 in 0.967s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e023700e-757a-4a26-a96b-37a5fe3cb866 tempest-VolumesDeleteCascade-2142546263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8.c9b5611f-caba-4f12-8605-780ba62610f4 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:03 devstack sudo[86375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8.c9b5611f-caba-4f12-8605-780ba62610f4 Apr 24 13:49:03 devstack sudo[86375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:04 devstack sudo[86373]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:04 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7ac794ef-4e74-41d3-a7b2-4b4e0513e5ab tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca.info" returned: 0 in 0.712s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:04 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-7ac794ef-4e74-41d3-a7b2-4b4e0513e5ab tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.577s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:49:04 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-769c3a35-c1f9-4558-9114-938848587773 tempest-AbsoluteLimitsTests-2090554133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.970s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:49:04 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-769c3a35-c1f9-4558-9114-938848587773 tempest-AbsoluteLimitsTests-2090554133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:48:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2071884240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3e94698-637c-48ec-9ad0-bbc317f47e05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb0eac5d78384e6b9141253097a5ad0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:48:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:48:51Z,use_quota=True,user_id='62bc568ff3e6464ea19d25851da820ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:49:04 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-769c3a35-c1f9-4558-9114-938848587773 tempest-AbsoluteLimitsTests-2090554133 None] Creating volume c3e94698-637c-48ec-9ad0-bbc317f47e05 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:49:04 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-769c3a35-c1f9-4558-9114-938848587773 tempest-AbsoluteLimitsTests-2090554133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:49:04 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-769c3a35-c1f9-4558-9114-938848587773 tempest-AbsoluteLimitsTests-2090554133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:49:04 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-769c3a35-c1f9-4558-9114-938848587773 tempest-AbsoluteLimitsTests-2090554133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:49:04 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-769c3a35-c1f9-4558-9114-938848587773 tempest-AbsoluteLimitsTests-2090554133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:49:04 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-769c3a35-c1f9-4558-9114-938848587773 tempest-AbsoluteLimitsTests-2090554133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:49:04 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-769c3a35-c1f9-4558-9114-938848587773 tempest-AbsoluteLimitsTests-2090554133 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:49:04 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-769c3a35-c1f9-4558-9114-938848587773 tempest-AbsoluteLimitsTests-2090554133 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:49:04 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-769c3a35-c1f9-4558-9114-938848587773 tempest-AbsoluteLimitsTests-2090554133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c3e94698-637c-48ec-9ad0-bbc317f47e05 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:04 devstack sudo[86379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c3e94698-637c-48ec-9ad0-bbc317f47e05 1073741824 Apr 24 13:49:04 devstack sudo[86379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:04 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-7ac794ef-4e74-41d3-a7b2-4b4e0513e5ab tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Create snapshot completed successfully Apr 24 13:49:04 devstack sudo[86375]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:04 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e023700e-757a-4a26-a96b-37a5fe3cb866 tempest-VolumesDeleteCascade-2142546263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8.c9b5611f-caba-4f12-8605-780ba62610f4" returned: 0 in 0.540s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:04 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e023700e-757a-4a26-a96b-37a5fe3cb866 tempest-VolumesDeleteCascade-2142546263 None] Lock "cinder-quobyte-c9b5611f-caba-4f12-8605-780ba62610f4" released by "_delete_snapshot" :: held 3.006s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:49:04 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e023700e-757a-4a26-a96b-37a5fe3cb866 tempest-VolumesDeleteCascade-2142546263 None] Lock "cinder-quobyte-cc0c26e7-4682-4485-9068-b2fbb82b60e8" released by "delete_snapshot" :: held 3.052s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:49:04 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-e023700e-757a-4a26-a96b-37a5fe3cb866 tempest-VolumesDeleteCascade-2142546263 None] Created reservations ['c3f44316-f8b2-4b53-aa5a-23e7e368a337', '973bbdc7-b3af-4fd9-94fd-11872e96bcbc', 'ff1c3260-8d5a-41c8-8b9d-31ff8606142d', '404c2ac1-6890-4f43-b5da-e3a7a3876a3c'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:49:04 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-e023700e-757a-4a26-a96b-37a5fe3cb866 tempest-VolumesDeleteCascade-2142546263 None] Delete snapshot completed successfully. Apr 24 13:49:04 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e023700e-757a-4a26-a96b-37a5fe3cb866 tempest-VolumesDeleteCascade-2142546263 None] Lock "cinder-c9b5611f-caba-4f12-8605-780ba62610f4-delete_snapshot" released by "delete_snapshot" :: held 3.338s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:49:04 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e023700e-757a-4a26-a96b-37a5fe3cb866 tempest-VolumesDeleteCascade-2142546263 None] Snapshots deleted, issuing volume delete {{(pid=82046) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 24 13:49:04 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e023700e-757a-4a26-a96b-37a5fe3cb866 tempest-VolumesDeleteCascade-2142546263 None] Acquiring lock "cinder-quobyte-cc0c26e7-4682-4485-9068-b2fbb82b60e8" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:49:04 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e023700e-757a-4a26-a96b-37a5fe3cb866 tempest-VolumesDeleteCascade-2142546263 None] Lock "cinder-quobyte-cc0c26e7-4682-4485-9068-b2fbb82b60e8" acquired by "delete_volume" :: waited 0.024s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:49:04 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5b86d9-c9f3-4b55-9a00-42b573c94790]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:49:04 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e023700e-757a-4a26-a96b-37a5fe3cb866 tempest-VolumesDeleteCascade-2142546263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:05 devstack sudo[86388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8 Apr 24 13:49:05 devstack sudo[86388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:05 devstack sudo[86379]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:05 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-769c3a35-c1f9-4558-9114-938848587773 tempest-AbsoluteLimitsTests-2090554133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c3e94698-637c-48ec-9ad0-bbc317f47e05 1073741824" returned: 0 in 0.988s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:05 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-769c3a35-c1f9-4558-9114-938848587773 tempest-AbsoluteLimitsTests-2090554133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c3e94698-637c-48ec-9ad0-bbc317f47e05 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:05 devstack sudo[86413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c3e94698-637c-48ec-9ad0-bbc317f47e05 Apr 24 13:49:05 devstack sudo[86413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:05 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-dae3268c-7bde-40b9-9f92-6c9aca0d3df0 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Acquiring lock "cinder-31aa7aef-4c8c-402e-b62b-44903973da7d-delete_snapshot" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:49:05 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-dae3268c-7bde-40b9-9f92-6c9aca0d3df0 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Lock "cinder-31aa7aef-4c8c-402e-b62b-44903973da7d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:49:05 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-dae3268c-7bde-40b9-9f92-6c9aca0d3df0 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Acquiring lock "cinder-quobyte-9bbd6a98-6aee-43a7-9f64-f8e7643514ca" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:49:05 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-dae3268c-7bde-40b9-9f92-6c9aca0d3df0 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Lock "cinder-quobyte-9bbd6a98-6aee-43a7-9f64-f8e7643514ca" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:49:05 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-dae3268c-7bde-40b9-9f92-6c9aca0d3df0 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Acquiring lock "cinder-quobyte-31aa7aef-4c8c-402e-b62b-44903973da7d" by "_delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:49:05 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-dae3268c-7bde-40b9-9f92-6c9aca0d3df0 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Lock "cinder-quobyte-31aa7aef-4c8c-402e-b62b-44903973da7d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:49:05 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-dae3268c-7bde-40b9-9f92-6c9aca0d3df0 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Deleting offline snapshot 31aa7aef-4c8c-402e-b62b-44903973da7d of volume 9bbd6a98-6aee-43a7-9f64-f8e7643514ca {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 13:49:05 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-dae3268c-7bde-40b9-9f92-6c9aca0d3df0 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] snapshot_file for this snap is: volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca.31aa7aef-4c8c-402e-b62b-44903973da7d {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 13:49:05 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d44cac5-a11b-4ffd-82dd-33d002327d60]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:49:05 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-dae3268c-7bde-40b9-9f92-6c9aca0d3df0 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca.31aa7aef-4c8c-402e-b62b-44903973da7d {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:05 devstack sudo[86420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca.31aa7aef-4c8c-402e-b62b-44903973da7d Apr 24 13:49:05 devstack sudo[86420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:05 devstack sudo[86388]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:05 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e023700e-757a-4a26-a96b-37a5fe3cb866 tempest-VolumesDeleteCascade-2142546263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8" returned: 0 in 1.027s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:05 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e023700e-757a-4a26-a96b-37a5fe3cb866 tempest-VolumesDeleteCascade-2142546263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:05 devstack sudo[86422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8 Apr 24 13:49:05 devstack sudo[86422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:06 devstack sudo[86413]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-769c3a35-c1f9-4558-9114-938848587773 tempest-AbsoluteLimitsTests-2090554133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c3e94698-637c-48ec-9ad0-bbc317f47e05" returned: 0 in 0.605s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:06 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-769c3a35-c1f9-4558-9114-938848587773 tempest-AbsoluteLimitsTests-2090554133 None] <== create_volume: return (1658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:49:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-769c3a35-c1f9-4558-9114-938848587773 tempest-AbsoluteLimitsTests-2090554133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.662s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:49:06 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-769c3a35-c1f9-4558-9114-938848587773 tempest-AbsoluteLimitsTests-2090554133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c242ac8f-900b-437c-a3af-93491c10b245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3e94698-637c-48ec-9ad0-bbc317f47e05', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:49:06 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-769c3a35-c1f9-4558-9114-938848587773 tempest-AbsoluteLimitsTests-2090554133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d4bbb5d-fe91-4926-9ddc-847ec43d191b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:49:06 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-769c3a35-c1f9-4558-9114-938848587773 tempest-AbsoluteLimitsTests-2090554133 None] Volume volume-c3e94698-637c-48ec-9ad0-bbc317f47e05 (c3e94698-637c-48ec-9ad0-bbc317f47e05): created successfully Apr 24 13:49:06 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-769c3a35-c1f9-4558-9114-938848587773 tempest-AbsoluteLimitsTests-2090554133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d4bbb5d-fe91-4926-9ddc-847ec43d191b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:49:06 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-769c3a35-c1f9-4558-9114-938848587773 tempest-AbsoluteLimitsTests-2090554133 None] Flow 'volume_create_manager' (61d6e437-f487-42c2-a1ce-c4688527d1c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:49:06 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-769c3a35-c1f9-4558-9114-938848587773 tempest-AbsoluteLimitsTests-2090554133 None] Created volume successfully. Apr 24 13:49:06 devstack sudo[86422]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e023700e-757a-4a26-a96b-37a5fe3cb866 tempest-VolumesDeleteCascade-2142546263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc0c26e7-4682-4485-9068-b2fbb82b60e8" returned: 0 in 0.500s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:06 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e023700e-757a-4a26-a96b-37a5fe3cb866 tempest-VolumesDeleteCascade-2142546263 None] Lock "cinder-quobyte-cc0c26e7-4682-4485-9068-b2fbb82b60e8" released by "delete_volume" :: held 1.609s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:49:06 devstack sudo[86420]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-dae3268c-7bde-40b9-9f92-6c9aca0d3df0 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca.31aa7aef-4c8c-402e-b62b-44903973da7d" returned: 0 in 0.671s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:06 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-dae3268c-7bde-40b9-9f92-6c9aca0d3df0 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:49:06 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[15269831-a896-4b57-b0f5-22c2290f2b03]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:49:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-dae3268c-7bde-40b9-9f92-6c9aca0d3df0 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:06 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-e023700e-757a-4a26-a96b-37a5fe3cb866 tempest-VolumesDeleteCascade-2142546263 None] Created reservations ['f5da8c06-fff3-4a73-8e6e-440f82c0a858', 'eddf2bc5-099e-4bf9-9076-255a717c3a01', '6712f7a8-d500-4c7c-85d4-c46fc0cef58c', '3ceb4bdf-b38b-426d-8e4c-bb5c7438b36b'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:49:06 devstack sudo[86430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca Apr 24 13:49:06 devstack sudo[86430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-e023700e-757a-4a26-a96b-37a5fe3cb866 tempest-VolumesDeleteCascade-2142546263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:49:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-e023700e-757a-4a26-a96b-37a5fe3cb866 tempest-VolumesDeleteCascade-2142546263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:49:06 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-e023700e-757a-4a26-a96b-37a5fe3cb866 tempest-VolumesDeleteCascade-2142546263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:49:06 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-e023700e-757a-4a26-a96b-37a5fe3cb866 tempest-VolumesDeleteCascade-2142546263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:49:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-e023700e-757a-4a26-a96b-37a5fe3cb866 tempest-VolumesDeleteCascade-2142546263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:49:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e023700e-757a-4a26-a96b-37a5fe3cb866 tempest-VolumesDeleteCascade-2142546263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:06 devstack sudo[86432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:49:06 devstack sudo[86432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:06 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-bd2c4593-a6a9-431a-b098-09201511f7cc tempest-VolumesDeleteCascade-2142546263 None] Acquiring lock "cinder-41102cda-c856-4f95-bb66-cbe24635e048-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:49:06 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-bd2c4593-a6a9-431a-b098-09201511f7cc tempest-VolumesDeleteCascade-2142546263 None] Lock "cinder-41102cda-c856-4f95-bb66-cbe24635e048-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:49:07 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-bd2c4593-a6a9-431a-b098-09201511f7cc tempest-VolumesDeleteCascade-2142546263 None] Acquiring lock "cinder-quobyte-41102cda-c856-4f95-bb66-cbe24635e048" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:49:07 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-bd2c4593-a6a9-431a-b098-09201511f7cc tempest-VolumesDeleteCascade-2142546263 None] Lock "cinder-quobyte-41102cda-c856-4f95-bb66-cbe24635e048" acquired by "delete_volume" :: waited 0.019s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:49:07 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e14d77-29f6-48ae-974c-496e3279ec62]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:49:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bd2c4593-a6a9-431a-b098-09201511f7cc tempest-VolumesDeleteCascade-2142546263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-41102cda-c856-4f95-bb66-cbe24635e048 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:07 devstack sudo[86430]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-dae3268c-7bde-40b9-9f92-6c9aca0d3df0 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca" returned: 0 in 0.824s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-dae3268c-7bde-40b9-9f92-6c9aca0d3df0 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca.31aa7aef-4c8c-402e-b62b-44903973da7d {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:07 devstack sudo[86438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-41102cda-c856-4f95-bb66-cbe24635e048 Apr 24 13:49:07 devstack sudo[86438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:07 devstack sudo[86440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca.31aa7aef-4c8c-402e-b62b-44903973da7d Apr 24 13:49:07 devstack sudo[86440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:07 devstack sudo[86432]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:07 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e309491f-279b-453d-afe9-bd024cbb1b8d tempest-AbsoluteLimitsTests-2090554133 None] Acquiring lock "cinder-c3e94698-637c-48ec-9ad0-bbc317f47e05-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:49:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e023700e-757a-4a26-a96b-37a5fe3cb866 tempest-VolumesDeleteCascade-2142546263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.753s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:07 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-e023700e-757a-4a26-a96b-37a5fe3cb866 tempest-VolumesDeleteCascade-2142546263 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:49:07 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e309491f-279b-453d-afe9-bd024cbb1b8d tempest-AbsoluteLimitsTests-2090554133 None] Lock "cinder-c3e94698-637c-48ec-9ad0-bbc317f47e05-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:49:07 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-e023700e-757a-4a26-a96b-37a5fe3cb866 tempest-VolumesDeleteCascade-2142546263 None] Deleted volume successfully. Apr 24 13:49:07 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e023700e-757a-4a26-a96b-37a5fe3cb866 tempest-VolumesDeleteCascade-2142546263 None] Lock "cinder-cc0c26e7-4682-4485-9068-b2fbb82b60e8-delete_volume" released by "delete_volume" :: held 6.098s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:49:07 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e309491f-279b-453d-afe9-bd024cbb1b8d tempest-AbsoluteLimitsTests-2090554133 None] Acquiring lock "cinder-quobyte-c3e94698-637c-48ec-9ad0-bbc317f47e05" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:49:07 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e309491f-279b-453d-afe9-bd024cbb1b8d tempest-AbsoluteLimitsTests-2090554133 None] Lock "cinder-quobyte-c3e94698-637c-48ec-9ad0-bbc317f47e05" acquired by "delete_volume" :: waited 0.020s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:49:07 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd5efd0-2b28-4110-999a-d1c92f580785]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:49:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e309491f-279b-453d-afe9-bd024cbb1b8d tempest-AbsoluteLimitsTests-2090554133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c3e94698-637c-48ec-9ad0-bbc317f47e05 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:07 devstack sudo[86443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c3e94698-637c-48ec-9ad0-bbc317f47e05 Apr 24 13:49:07 devstack sudo[86443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:07 devstack sudo[86438]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bd2c4593-a6a9-431a-b098-09201511f7cc tempest-VolumesDeleteCascade-2142546263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-41102cda-c856-4f95-bb66-cbe24635e048" returned: 0 in 0.750s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bd2c4593-a6a9-431a-b098-09201511f7cc tempest-VolumesDeleteCascade-2142546263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-41102cda-c856-4f95-bb66-cbe24635e048 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:07 devstack sudo[86452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-41102cda-c856-4f95-bb66-cbe24635e048 Apr 24 13:49:07 devstack sudo[86452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:07 devstack cinder-volume[82046]: INFO cinder.volume.manager [req-303a8490-c056-4ad3-882f-9a7670b37a3c req-5f897158-b568-4d3f-9362-d647b7c29277 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Terminate volume connection completed successfully. Apr 24 13:49:07 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-303a8490-c056-4ad3-882f-9a7670b37a3c req-5f897158-b568-4d3f-9362-d647b7c29277 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Deleting attachment ade16f18-fb7a-4fb7-b8b4-2768236aa689. {{(pid=82046) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 24 13:49:07 devstack sudo[86440]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-dae3268c-7bde-40b9-9f92-6c9aca0d3df0 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca.31aa7aef-4c8c-402e-b62b-44903973da7d" returned: 0 in 0.732s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-dae3268c-7bde-40b9-9f92-6c9aca0d3df0 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca.31aa7aef-4c8c-402e-b62b-44903973da7d {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:07 devstack sudo[86457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca.31aa7aef-4c8c-402e-b62b-44903973da7d Apr 24 13:49:07 devstack sudo[86457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:08 devstack sudo[86443]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e309491f-279b-453d-afe9-bd024cbb1b8d tempest-AbsoluteLimitsTests-2090554133 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c3e94698-637c-48ec-9ad0-bbc317f47e05" returned: 0 in 0.607s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e309491f-279b-453d-afe9-bd024cbb1b8d tempest-AbsoluteLimitsTests-2090554133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c3e94698-637c-48ec-9ad0-bbc317f47e05 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:08 devstack sudo[86459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c3e94698-637c-48ec-9ad0-bbc317f47e05 Apr 24 13:49:08 devstack sudo[86459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:08 devstack sudo[86452]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bd2c4593-a6a9-431a-b098-09201511f7cc tempest-VolumesDeleteCascade-2142546263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-41102cda-c856-4f95-bb66-cbe24635e048" returned: 0 in 0.543s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:08 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-bd2c4593-a6a9-431a-b098-09201511f7cc tempest-VolumesDeleteCascade-2142546263 None] Lock "cinder-quobyte-41102cda-c856-4f95-bb66-cbe24635e048" released by "delete_volume" :: held 1.346s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:49:08 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-bd2c4593-a6a9-431a-b098-09201511f7cc tempest-VolumesDeleteCascade-2142546263 None] Created reservations ['d8902edb-c26d-4245-b982-f2ec3ae70387', 'f6d0e4dc-bce3-4da7-a823-929f4670e23f', 'fa487f73-3435-4e3c-983d-dbcd226e78dd', '2c667529-c0f0-42be-8116-a56a4e39759c'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:49:08 devstack sudo[86457]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-dae3268c-7bde-40b9-9f92-6c9aca0d3df0 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca.31aa7aef-4c8c-402e-b62b-44903973da7d" returned: 0 in 0.549s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:08 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-dae3268c-7bde-40b9-9f92-6c9aca0d3df0 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Lock "cinder-quobyte-31aa7aef-4c8c-402e-b62b-44903973da7d" released by "_delete_snapshot" :: held 2.959s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:49:08 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-dae3268c-7bde-40b9-9f92-6c9aca0d3df0 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Lock "cinder-quobyte-9bbd6a98-6aee-43a7-9f64-f8e7643514ca" released by "delete_snapshot" :: held 3.000s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:49:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-bd2c4593-a6a9-431a-b098-09201511f7cc tempest-VolumesDeleteCascade-2142546263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:49:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-bd2c4593-a6a9-431a-b098-09201511f7cc tempest-VolumesDeleteCascade-2142546263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:49:08 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-bd2c4593-a6a9-431a-b098-09201511f7cc tempest-VolumesDeleteCascade-2142546263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:49:08 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-bd2c4593-a6a9-431a-b098-09201511f7cc tempest-VolumesDeleteCascade-2142546263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:49:08 devstack sudo[86459]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-bd2c4593-a6a9-431a-b098-09201511f7cc tempest-VolumesDeleteCascade-2142546263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:49:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bd2c4593-a6a9-431a-b098-09201511f7cc tempest-VolumesDeleteCascade-2142546263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e309491f-279b-453d-afe9-bd024cbb1b8d tempest-AbsoluteLimitsTests-2090554133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c3e94698-637c-48ec-9ad0-bbc317f47e05" returned: 0 in 0.632s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:08 devstack sudo[86464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:49:08 devstack sudo[86464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:08 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e309491f-279b-453d-afe9-bd024cbb1b8d tempest-AbsoluteLimitsTests-2090554133 None] Lock "cinder-quobyte-c3e94698-637c-48ec-9ad0-bbc317f47e05" released by "delete_volume" :: held 1.295s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:49:08 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-e309491f-279b-453d-afe9-bd024cbb1b8d tempest-AbsoluteLimitsTests-2090554133 None] Created reservations ['b6da2f8d-7008-4e37-a0eb-0108c6da7a4b', '12a11cbc-09c2-4a21-bfdb-23fc77e20fe4', 'd3f754dd-90e9-4175-9808-e89e860eea5f', '1286d56e-250c-48de-9d14-9bc014008029'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:49:08 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-dae3268c-7bde-40b9-9f92-6c9aca0d3df0 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Created reservations ['19959e5d-fe87-4bae-9b22-1b214a908ba1', '04c986c1-99d2-4756-9bb9-9099e05bc953', 'ff1d88e7-d2a4-440e-b942-c6a5c305e4c6', 'a13e4d85-7b57-4da1-afe5-e1d52659041c'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:49:08 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-dae3268c-7bde-40b9-9f92-6c9aca0d3df0 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Delete snapshot completed successfully. Apr 24 13:49:08 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-dae3268c-7bde-40b9-9f92-6c9aca0d3df0 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Lock "cinder-31aa7aef-4c8c-402e-b62b-44903973da7d-delete_snapshot" released by "delete_snapshot" :: held 3.251s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:49:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-e309491f-279b-453d-afe9-bd024cbb1b8d tempest-AbsoluteLimitsTests-2090554133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:49:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-e309491f-279b-453d-afe9-bd024cbb1b8d tempest-AbsoluteLimitsTests-2090554133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:49:08 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-e309491f-279b-453d-afe9-bd024cbb1b8d tempest-AbsoluteLimitsTests-2090554133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:49:08 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-e309491f-279b-453d-afe9-bd024cbb1b8d tempest-AbsoluteLimitsTests-2090554133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:49:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-e309491f-279b-453d-afe9-bd024cbb1b8d tempest-AbsoluteLimitsTests-2090554133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:49:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e309491f-279b-453d-afe9-bd024cbb1b8d tempest-AbsoluteLimitsTests-2090554133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:08 devstack cinder-volume[82046]: DEBUG cinder.coordination [req-303a8490-c056-4ad3-882f-9a7670b37a3c req-e7b7d5a0-6502-4103-94e6-17e8a8c39bb0 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Acquiring lock "cinder-f5cbeb5d-8080-4519-a829-34efa5a0576d-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:49:08 devstack sudo[86466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:49:08 devstack sudo[86466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:08 devstack cinder-volume[82046]: DEBUG cinder.coordination [req-303a8490-c056-4ad3-882f-9a7670b37a3c req-e7b7d5a0-6502-4103-94e6-17e8a8c39bb0 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Lock "cinder-f5cbeb5d-8080-4519-a829-34efa5a0576d-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:49:09 devstack cinder-volume[82046]: DEBUG cinder.coordination [req-303a8490-c056-4ad3-882f-9a7670b37a3c req-e7b7d5a0-6502-4103-94e6-17e8a8c39bb0 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Acquiring lock "cinder-quobyte-f5cbeb5d-8080-4519-a829-34efa5a0576d" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:49:09 devstack cinder-volume[82046]: DEBUG cinder.coordination [req-303a8490-c056-4ad3-882f-9a7670b37a3c req-e7b7d5a0-6502-4103-94e6-17e8a8c39bb0 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Lock "cinder-quobyte-f5cbeb5d-8080-4519-a829-34efa5a0576d" acquired by "delete_volume" :: waited 0.026s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:49:09 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f3ebb7-3765-4df4-8120-b24f3a495325]: (4, 'raw') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:49:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-303a8490-c056-4ad3-882f-9a7670b37a3c req-e7b7d5a0-6502-4103-94e6-17e8a8c39bb0 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f5cbeb5d-8080-4519-a829-34efa5a0576d {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:09 devstack sudo[86468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f5cbeb5d-8080-4519-a829-34efa5a0576d Apr 24 13:49:09 devstack sudo[86468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:09 devstack sudo[86464]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bd2c4593-a6a9-431a-b098-09201511f7cc tempest-VolumesDeleteCascade-2142546263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.802s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:09 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-bd2c4593-a6a9-431a-b098-09201511f7cc tempest-VolumesDeleteCascade-2142546263 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:49:09 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-bd2c4593-a6a9-431a-b098-09201511f7cc tempest-VolumesDeleteCascade-2142546263 None] Deleted volume successfully. Apr 24 13:49:09 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-bd2c4593-a6a9-431a-b098-09201511f7cc tempest-VolumesDeleteCascade-2142546263 None] Lock "cinder-41102cda-c856-4f95-bb66-cbe24635e048-delete_volume" released by "delete_volume" :: held 2.488s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:49:09 devstack sudo[86466]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e309491f-279b-453d-afe9-bd024cbb1b8d tempest-AbsoluteLimitsTests-2090554133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.718s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:09 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-e309491f-279b-453d-afe9-bd024cbb1b8d tempest-AbsoluteLimitsTests-2090554133 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:49:09 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-e309491f-279b-453d-afe9-bd024cbb1b8d tempest-AbsoluteLimitsTests-2090554133 None] Deleted volume successfully. Apr 24 13:49:09 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e309491f-279b-453d-afe9-bd024cbb1b8d tempest-AbsoluteLimitsTests-2090554133 None] Lock "cinder-c3e94698-637c-48ec-9ad0-bbc317f47e05-delete_volume" released by "delete_volume" :: held 2.348s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:49:09 devstack sudo[86468]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-303a8490-c056-4ad3-882f-9a7670b37a3c req-e7b7d5a0-6502-4103-94e6-17e8a8c39bb0 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f5cbeb5d-8080-4519-a829-34efa5a0576d" returned: 0 in 0.815s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-303a8490-c056-4ad3-882f-9a7670b37a3c req-e7b7d5a0-6502-4103-94e6-17e8a8c39bb0 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f5cbeb5d-8080-4519-a829-34efa5a0576d {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:09 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-1580f21f-7e08-4f57-bf61-c625f0d2af46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Acquiring lock "cinder-9bbd6a98-6aee-43a7-9f64-f8e7643514ca-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:49:10 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-1580f21f-7e08-4f57-bf61-c625f0d2af46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Lock "cinder-9bbd6a98-6aee-43a7-9f64-f8e7643514ca-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:49:10 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-1580f21f-7e08-4f57-bf61-c625f0d2af46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Acquiring lock "cinder-quobyte-9bbd6a98-6aee-43a7-9f64-f8e7643514ca" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:49:10 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-1580f21f-7e08-4f57-bf61-c625f0d2af46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Lock "cinder-quobyte-9bbd6a98-6aee-43a7-9f64-f8e7643514ca" acquired by "delete_volume" :: waited 0.037s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:49:10 devstack sudo[86474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f5cbeb5d-8080-4519-a829-34efa5a0576d Apr 24 13:49:10 devstack sudo[86474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:10 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ffc414-4a2b-4f62-ab1a-4948243f56c4]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:49:10 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-1580f21f-7e08-4f57-bf61-c625f0d2af46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:10 devstack sudo[86476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca Apr 24 13:49:10 devstack sudo[86476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:10 devstack sudo[86474]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:10 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-303a8490-c056-4ad3-882f-9a7670b37a3c req-e7b7d5a0-6502-4103-94e6-17e8a8c39bb0 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f5cbeb5d-8080-4519-a829-34efa5a0576d" returned: 1 in 0.894s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:10 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-303a8490-c056-4ad3-882f-9a7670b37a3c req-e7b7d5a0-6502-4103-94e6-17e8a8c39bb0 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f5cbeb5d-8080-4519-a829-34efa5a0576d' failed. Not Retrying. {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 13:49:10 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-303a8490-c056-4ad3-882f-9a7670b37a3c req-e7b7d5a0-6502-4103-94e6-17e8a8c39bb0 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f5cbeb5d-8080-4519-a829-34efa5a0576d {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:10 devstack sudo[86482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f5cbeb5d-8080-4519-a829-34efa5a0576d Apr 24 13:49:10 devstack sudo[86482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:11 devstack sudo[86476]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-1580f21f-7e08-4f57-bf61-c625f0d2af46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca" returned: 0 in 0.862s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-1580f21f-7e08-4f57-bf61-c625f0d2af46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:11 devstack sudo[86486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca Apr 24 13:49:11 devstack sudo[86486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:11 devstack sudo[86486]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-1580f21f-7e08-4f57-bf61-c625f0d2af46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bbd6a98-6aee-43a7-9f64-f8e7643514ca" returned: 0 in 0.908s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:11 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-1580f21f-7e08-4f57-bf61-c625f0d2af46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Lock "cinder-quobyte-9bbd6a98-6aee-43a7-9f64-f8e7643514ca" released by "delete_volume" :: held 1.872s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:49:12 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-1580f21f-7e08-4f57-bf61-c625f0d2af46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Created reservations ['ba55e67b-cfc9-492e-86f5-9d9df0c1a1d4', 'ffe77fc8-21a1-4ce4-9812-9a635063bb81', '94909776-6c07-4ac5-993e-6b8ac70a0b0c', '319332eb-e2be-4447-bd4f-58b9bc128e4a'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:49:12 devstack sudo[86482]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-303a8490-c056-4ad3-882f-9a7670b37a3c req-e7b7d5a0-6502-4103-94e6-17e8a8c39bb0 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f5cbeb5d-8080-4519-a829-34efa5a0576d" returned: 0 in 1.265s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:12 devstack cinder-volume[82046]: DEBUG cinder.coordination [req-303a8490-c056-4ad3-882f-9a7670b37a3c req-e7b7d5a0-6502-4103-94e6-17e8a8c39bb0 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Lock "cinder-quobyte-f5cbeb5d-8080-4519-a829-34efa5a0576d" released by "delete_volume" :: held 3.080s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:49:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-1580f21f-7e08-4f57-bf61-c625f0d2af46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:49:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-1580f21f-7e08-4f57-bf61-c625f0d2af46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:49:12 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-1580f21f-7e08-4f57-bf61-c625f0d2af46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:49:12 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-1580f21f-7e08-4f57-bf61-c625f0d2af46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:49:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-1580f21f-7e08-4f57-bf61-c625f0d2af46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:49:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-1580f21f-7e08-4f57-bf61-c625f0d2af46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:12 devstack cinder-volume[82046]: DEBUG cinder.quota [req-303a8490-c056-4ad3-882f-9a7670b37a3c req-e7b7d5a0-6502-4103-94e6-17e8a8c39bb0 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Created reservations ['c7d64291-53ae-4d22-9731-16d3674dba33', '8ef0290e-b084-4891-bfeb-eb32afd83319', '9476c01f-b00e-40e5-8881-8410bfa6c3f9', '1852431a-1fb6-4ed9-923d-bf1779c942d5'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:49:12 devstack sudo[86490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:49:12 devstack sudo[86490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [req-303a8490-c056-4ad3-882f-9a7670b37a3c req-e7b7d5a0-6502-4103-94e6-17e8a8c39bb0 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:49:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [req-303a8490-c056-4ad3-882f-9a7670b37a3c req-e7b7d5a0-6502-4103-94e6-17e8a8c39bb0 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:49:12 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [req-303a8490-c056-4ad3-882f-9a7670b37a3c req-e7b7d5a0-6502-4103-94e6-17e8a8c39bb0 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:49:12 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [req-303a8490-c056-4ad3-882f-9a7670b37a3c req-e7b7d5a0-6502-4103-94e6-17e8a8c39bb0 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:49:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [req-303a8490-c056-4ad3-882f-9a7670b37a3c req-e7b7d5a0-6502-4103-94e6-17e8a8c39bb0 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:49:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-303a8490-c056-4ad3-882f-9a7670b37a3c req-e7b7d5a0-6502-4103-94e6-17e8a8c39bb0 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:12 devstack sudo[86492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:49:12 devstack sudo[86492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:13 devstack sudo[86490]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-1580f21f-7e08-4f57-bf61-c625f0d2af46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.799s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:13 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-1580f21f-7e08-4f57-bf61-c625f0d2af46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:49:13 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-1580f21f-7e08-4f57-bf61-c625f0d2af46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Deleted volume successfully. Apr 24 13:49:13 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-1580f21f-7e08-4f57-bf61-c625f0d2af46 tempest-VolumeSnapshotQuotasNegativeTestJSON-2072927787 None] Lock "cinder-9bbd6a98-6aee-43a7-9f64-f8e7643514ca-delete_volume" released by "delete_volume" :: held 3.054s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:49:13 devstack sudo[86492]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-303a8490-c056-4ad3-882f-9a7670b37a3c req-e7b7d5a0-6502-4103-94e6-17e8a8c39bb0 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.830s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:13 devstack cinder-volume[82046]: DEBUG cinder.manager [req-303a8490-c056-4ad3-882f-9a7670b37a3c req-e7b7d5a0-6502-4103-94e6-17e8a8c39bb0 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:49:13 devstack cinder-volume[82046]: INFO cinder.volume.manager [req-303a8490-c056-4ad3-882f-9a7670b37a3c req-e7b7d5a0-6502-4103-94e6-17e8a8c39bb0 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Deleted volume successfully. Apr 24 13:49:13 devstack cinder-volume[82046]: DEBUG cinder.coordination [req-303a8490-c056-4ad3-882f-9a7670b37a3c req-e7b7d5a0-6502-4103-94e6-17e8a8c39bb0 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Lock "cinder-f5cbeb5d-8080-4519-a829-34efa5a0576d-delete_volume" released by "delete_volume" :: held 4.265s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:49:17 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-0693160c-0921-4344-8548-dc3a82cdf1a1 tempest-VolumesTransfersV355Test-908611517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:49:17 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0693160c-0921-4344-8548-dc3a82cdf1a1 tempest-VolumesTransfersV355Test-908611517 None] Flow 'volume_create_manager' (8b345987-e1ef-487c-b23a-80973aafb78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:49:17 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0693160c-0921-4344-8548-dc3a82cdf1a1 tempest-VolumesTransfersV355Test-908611517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b88141ff-aae3-49f1-9b06-8d0b7f7ceaa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:49:17 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0693160c-0921-4344-8548-dc3a82cdf1a1 tempest-VolumesTransfersV355Test-908611517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b88141ff-aae3-49f1-9b06-8d0b7f7ceaa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:49:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1134890992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a551a69-8197-4f80-b318-ea1456b5c382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a5298c4f7af45799d6a48008dc3f1e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:49:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:49:17Z,use_quota=True,user_id='72ebfd64e1154ee29469729cd6f12345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:49:17 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0693160c-0921-4344-8548-dc3a82cdf1a1 tempest-VolumesTransfersV355Test-908611517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c75045e-3979-4922-8f61-5c2efae77612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:49:17 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0693160c-0921-4344-8548-dc3a82cdf1a1 tempest-VolumesTransfersV355Test-908611517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c75045e-3979-4922-8f61-5c2efae77612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:49:17 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0693160c-0921-4344-8548-dc3a82cdf1a1 tempest-VolumesTransfersV355Test-908611517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d64bf967-8f3a-4e10-abe8-bb8814b7ff50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:49:17 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0693160c-0921-4344-8548-dc3a82cdf1a1 tempest-VolumesTransfersV355Test-908611517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d64bf967-8f3a-4e10-abe8-bb8814b7ff50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a551a69-8197-4f80-b318-ea1456b5c382', 'volume_name': 'volume-5a551a69-8197-4f80-b318-ea1456b5c382', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:49:17 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0693160c-0921-4344-8548-dc3a82cdf1a1 tempest-VolumesTransfersV355Test-908611517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6c5eeb4-bcbd-4137-8a94-b6d5075587dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:49:17 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0693160c-0921-4344-8548-dc3a82cdf1a1 tempest-VolumesTransfersV355Test-908611517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6c5eeb4-bcbd-4137-8a94-b6d5075587dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:49:17 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0693160c-0921-4344-8548-dc3a82cdf1a1 tempest-VolumesTransfersV355Test-908611517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (620255df-2b74-4ec0-bd27-ead12711c65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:49:17 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-0693160c-0921-4344-8548-dc3a82cdf1a1 tempest-VolumesTransfersV355Test-908611517 None] Volume 5a551a69-8197-4f80-b318-ea1456b5c382: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a551a69-8197-4f80-b318-ea1456b5c382', 'volume_size': 1} Apr 24 13:49:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0693160c-0921-4344-8548-dc3a82cdf1a1 tempest-VolumesTransfersV355Test-908611517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:49:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0693160c-0921-4344-8548-dc3a82cdf1a1 tempest-VolumesTransfersV355Test-908611517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:49:17 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-0693160c-0921-4344-8548-dc3a82cdf1a1 tempest-VolumesTransfersV355Test-908611517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:49:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1134890992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a551a69-8197-4f80-b318-ea1456b5c382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a5298c4f7af45799d6a48008dc3f1e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:49:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:49:17Z,use_quota=True,user_id='72ebfd64e1154ee29469729cd6f12345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:49:17 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-0693160c-0921-4344-8548-dc3a82cdf1a1 tempest-VolumesTransfersV355Test-908611517 None] Creating volume 5a551a69-8197-4f80-b318-ea1456b5c382 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:49:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0693160c-0921-4344-8548-dc3a82cdf1a1 tempest-VolumesTransfersV355Test-908611517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:49:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0693160c-0921-4344-8548-dc3a82cdf1a1 tempest-VolumesTransfersV355Test-908611517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:49:17 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-0693160c-0921-4344-8548-dc3a82cdf1a1 tempest-VolumesTransfersV355Test-908611517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:49:17 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-0693160c-0921-4344-8548-dc3a82cdf1a1 tempest-VolumesTransfersV355Test-908611517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:49:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0693160c-0921-4344-8548-dc3a82cdf1a1 tempest-VolumesTransfersV355Test-908611517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:49:17 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-0693160c-0921-4344-8548-dc3a82cdf1a1 tempest-VolumesTransfersV355Test-908611517 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:49:17 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-0693160c-0921-4344-8548-dc3a82cdf1a1 tempest-VolumesTransfersV355Test-908611517 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:49:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0693160c-0921-4344-8548-dc3a82cdf1a1 tempest-VolumesTransfersV355Test-908611517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5a551a69-8197-4f80-b318-ea1456b5c382 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:17 devstack sudo[86563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5a551a69-8197-4f80-b318-ea1456b5c382 1073741824 Apr 24 13:49:17 devstack sudo[86563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:18 devstack sudo[86563]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:18 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0693160c-0921-4344-8548-dc3a82cdf1a1 tempest-VolumesTransfersV355Test-908611517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5a551a69-8197-4f80-b318-ea1456b5c382 1073741824" returned: 0 in 0.834s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:18 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0693160c-0921-4344-8548-dc3a82cdf1a1 tempest-VolumesTransfersV355Test-908611517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5a551a69-8197-4f80-b318-ea1456b5c382 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:18 devstack sudo[86569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5a551a69-8197-4f80-b318-ea1456b5c382 Apr 24 13:49:18 devstack sudo[86569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:19 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d2c9980-2559-468f-8068-822c6522845b tempest-VolumesTransfersV357Test-1586561100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:49:19 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8d2c9980-2559-468f-8068-822c6522845b tempest-VolumesTransfersV357Test-1586561100 None] Flow 'volume_create_manager' (a108743a-73aa-4997-9a3f-48e84eb34fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:49:19 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8d2c9980-2559-468f-8068-822c6522845b tempest-VolumesTransfersV357Test-1586561100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da16fa24-11df-46e7-9d1b-8fd9048ea0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:49:19 devstack sudo[86569]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0693160c-0921-4344-8548-dc3a82cdf1a1 tempest-VolumesTransfersV355Test-908611517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5a551a69-8197-4f80-b318-ea1456b5c382" returned: 0 in 0.736s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:19 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-0693160c-0921-4344-8548-dc3a82cdf1a1 tempest-VolumesTransfersV355Test-908611517 None] <== create_volume: return (1626ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:49:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0693160c-0921-4344-8548-dc3a82cdf1a1 tempest-VolumesTransfersV355Test-908611517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.630s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:49:19 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8d2c9980-2559-468f-8068-822c6522845b tempest-VolumesTransfersV357Test-1586561100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da16fa24-11df-46e7-9d1b-8fd9048ea0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:49:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1925270823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3930abf2-55d4-4aa2-9395-4adf1a03fd17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7da21aaf92004a3aa96f9a0ceece7634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:49:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:49:19Z,use_quota=True,user_id='f1861c64d8ec4b15899c1a143352f744',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:49:19 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8d2c9980-2559-468f-8068-822c6522845b tempest-VolumesTransfersV357Test-1586561100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adafd934-598f-4f49-8573-c650bd7855ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:49:19 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8d2c9980-2559-468f-8068-822c6522845b tempest-VolumesTransfersV357Test-1586561100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adafd934-598f-4f49-8573-c650bd7855ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:49:19 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8d2c9980-2559-468f-8068-822c6522845b tempest-VolumesTransfersV357Test-1586561100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bc4501a-70a0-4005-ae09-45d7c60ac8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:49:19 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8d2c9980-2559-468f-8068-822c6522845b tempest-VolumesTransfersV357Test-1586561100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bc4501a-70a0-4005-ae09-45d7c60ac8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3930abf2-55d4-4aa2-9395-4adf1a03fd17', 'volume_name': 'volume-3930abf2-55d4-4aa2-9395-4adf1a03fd17', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:49:19 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8d2c9980-2559-468f-8068-822c6522845b tempest-VolumesTransfersV357Test-1586561100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52869640-e98c-4f0d-bd53-83410c8511d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:49:19 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8d2c9980-2559-468f-8068-822c6522845b tempest-VolumesTransfersV357Test-1586561100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52869640-e98c-4f0d-bd53-83410c8511d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:49:19 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8d2c9980-2559-468f-8068-822c6522845b tempest-VolumesTransfersV357Test-1586561100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (142b8746-0533-4384-837a-63f5e4f4210c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:49:19 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-8d2c9980-2559-468f-8068-822c6522845b tempest-VolumesTransfersV357Test-1586561100 None] Volume 3930abf2-55d4-4aa2-9395-4adf1a03fd17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3930abf2-55d4-4aa2-9395-4adf1a03fd17', 'volume_size': 1} Apr 24 13:49:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-8d2c9980-2559-468f-8068-822c6522845b tempest-VolumesTransfersV357Test-1586561100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:49:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-8d2c9980-2559-468f-8068-822c6522845b tempest-VolumesTransfersV357Test-1586561100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:49:19 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-8d2c9980-2559-468f-8068-822c6522845b tempest-VolumesTransfersV357Test-1586561100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:49:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1925270823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3930abf2-55d4-4aa2-9395-4adf1a03fd17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7da21aaf92004a3aa96f9a0ceece7634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:49:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:49:19Z,use_quota=True,user_id='f1861c64d8ec4b15899c1a143352f744',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:49:19 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-8d2c9980-2559-468f-8068-822c6522845b tempest-VolumesTransfersV357Test-1586561100 None] Creating volume 3930abf2-55d4-4aa2-9395-4adf1a03fd17 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:49:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-8d2c9980-2559-468f-8068-822c6522845b tempest-VolumesTransfersV357Test-1586561100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:49:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-8d2c9980-2559-468f-8068-822c6522845b tempest-VolumesTransfersV357Test-1586561100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:49:19 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-8d2c9980-2559-468f-8068-822c6522845b tempest-VolumesTransfersV357Test-1586561100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:49:19 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-8d2c9980-2559-468f-8068-822c6522845b tempest-VolumesTransfersV357Test-1586561100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:49:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-8d2c9980-2559-468f-8068-822c6522845b tempest-VolumesTransfersV357Test-1586561100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:49:19 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-8d2c9980-2559-468f-8068-822c6522845b tempest-VolumesTransfersV357Test-1586561100 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:49:19 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-8d2c9980-2559-468f-8068-822c6522845b tempest-VolumesTransfersV357Test-1586561100 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:49:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8d2c9980-2559-468f-8068-822c6522845b tempest-VolumesTransfersV357Test-1586561100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-3930abf2-55d4-4aa2-9395-4adf1a03fd17 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:19 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0693160c-0921-4344-8548-dc3a82cdf1a1 tempest-VolumesTransfersV355Test-908611517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (620255df-2b74-4ec0-bd27-ead12711c65c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a551a69-8197-4f80-b318-ea1456b5c382', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:49:19 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0693160c-0921-4344-8548-dc3a82cdf1a1 tempest-VolumesTransfersV355Test-908611517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d075681-76ae-4883-bb19-dd443eef4800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:49:19 devstack sudo[86572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-3930abf2-55d4-4aa2-9395-4adf1a03fd17 1073741824 Apr 24 13:49:19 devstack sudo[86572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:19 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-0693160c-0921-4344-8548-dc3a82cdf1a1 tempest-VolumesTransfersV355Test-908611517 None] Volume volume-5a551a69-8197-4f80-b318-ea1456b5c382 (5a551a69-8197-4f80-b318-ea1456b5c382): created successfully Apr 24 13:49:19 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0693160c-0921-4344-8548-dc3a82cdf1a1 tempest-VolumesTransfersV355Test-908611517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d075681-76ae-4883-bb19-dd443eef4800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:49:19 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0693160c-0921-4344-8548-dc3a82cdf1a1 tempest-VolumesTransfersV355Test-908611517 None] Flow 'volume_create_manager' (8b345987-e1ef-487c-b23a-80973aafb78b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:49:19 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-0693160c-0921-4344-8548-dc3a82cdf1a1 tempest-VolumesTransfersV355Test-908611517 None] Created volume successfully. Apr 24 13:49:20 devstack sudo[86572]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8d2c9980-2559-468f-8068-822c6522845b tempest-VolumesTransfersV357Test-1586561100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-3930abf2-55d4-4aa2-9395-4adf1a03fd17 1073741824" returned: 0 in 1.059s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8d2c9980-2559-468f-8068-822c6522845b tempest-VolumesTransfersV357Test-1586561100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-3930abf2-55d4-4aa2-9395-4adf1a03fd17 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:20 devstack sudo[86577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-3930abf2-55d4-4aa2-9395-4adf1a03fd17 Apr 24 13:49:20 devstack sudo[86577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:20 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-8385f9d5-b114-4eb6-b13f-c009552b95ab tempest-VolumesTransfersV355Test-2009166064 None] Transfer volume completed successfully. Apr 24 13:49:20 devstack sudo[86577]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8d2c9980-2559-468f-8068-822c6522845b tempest-VolumesTransfersV357Test-1586561100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-3930abf2-55d4-4aa2-9395-4adf1a03fd17" returned: 0 in 0.572s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:20 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-8d2c9980-2559-468f-8068-822c6522845b tempest-VolumesTransfersV357Test-1586561100 None] <== create_volume: return (1681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:49:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-8d2c9980-2559-468f-8068-822c6522845b tempest-VolumesTransfersV357Test-1586561100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.685s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:49:20 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8d2c9980-2559-468f-8068-822c6522845b tempest-VolumesTransfersV357Test-1586561100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (142b8746-0533-4384-837a-63f5e4f4210c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3930abf2-55d4-4aa2-9395-4adf1a03fd17', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:49:20 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8d2c9980-2559-468f-8068-822c6522845b tempest-VolumesTransfersV357Test-1586561100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5782001-d15f-4e65-8db9-9084f74762a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:49:21 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-8d2c9980-2559-468f-8068-822c6522845b tempest-VolumesTransfersV357Test-1586561100 None] Volume volume-3930abf2-55d4-4aa2-9395-4adf1a03fd17 (3930abf2-55d4-4aa2-9395-4adf1a03fd17): created successfully Apr 24 13:49:21 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8d2c9980-2559-468f-8068-822c6522845b tempest-VolumesTransfersV357Test-1586561100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5782001-d15f-4e65-8db9-9084f74762a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:49:21 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8d2c9980-2559-468f-8068-822c6522845b tempest-VolumesTransfersV357Test-1586561100 None] Flow 'volume_create_manager' (a108743a-73aa-4997-9a3f-48e84eb34fa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:49:21 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-8d2c9980-2559-468f-8068-822c6522845b tempest-VolumesTransfersV357Test-1586561100 None] Created volume successfully. Apr 24 13:49:21 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-34c21766-3436-48e4-961c-7afa66c37729 tempest-VolumesTransfersV355Test-183142284 None] Acquiring lock "cinder-5a551a69-8197-4f80-b318-ea1456b5c382-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:49:21 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-34c21766-3436-48e4-961c-7afa66c37729 tempest-VolumesTransfersV355Test-183142284 None] Lock "cinder-5a551a69-8197-4f80-b318-ea1456b5c382-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:49:21 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-34c21766-3436-48e4-961c-7afa66c37729 tempest-VolumesTransfersV355Test-183142284 None] Acquiring lock "cinder-quobyte-5a551a69-8197-4f80-b318-ea1456b5c382" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:49:21 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-34c21766-3436-48e4-961c-7afa66c37729 tempest-VolumesTransfersV355Test-183142284 None] Lock "cinder-quobyte-5a551a69-8197-4f80-b318-ea1456b5c382" acquired by "delete_volume" :: waited 0.017s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:49:21 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d879081-e6ed-4c00-a3aa-3dd08f6e3633]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:49:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-34c21766-3436-48e4-961c-7afa66c37729 tempest-VolumesTransfersV355Test-183142284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5a551a69-8197-4f80-b318-ea1456b5c382 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:21 devstack sudo[86580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5a551a69-8197-4f80-b318-ea1456b5c382 Apr 24 13:49:21 devstack sudo[86580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:22 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-0224403f-6919-45c9-b088-e70caecc2cef tempest-VolumesTransfersV357Test-1890159813 None] Transfer volume completed successfully. Apr 24 13:49:22 devstack sudo[86580]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-34c21766-3436-48e4-961c-7afa66c37729 tempest-VolumesTransfersV355Test-183142284 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5a551a69-8197-4f80-b318-ea1456b5c382" returned: 0 in 0.715s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-34c21766-3436-48e4-961c-7afa66c37729 tempest-VolumesTransfersV355Test-183142284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5a551a69-8197-4f80-b318-ea1456b5c382 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:22 devstack sudo[86586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5a551a69-8197-4f80-b318-ea1456b5c382 Apr 24 13:49:22 devstack sudo[86586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:23 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-accfa455-198f-4e9c-9c1e-efcb2788bf7d tempest-VolumesTransfersV357Test-904592315 None] Acquiring lock "cinder-3930abf2-55d4-4aa2-9395-4adf1a03fd17-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:49:23 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-accfa455-198f-4e9c-9c1e-efcb2788bf7d tempest-VolumesTransfersV357Test-904592315 None] Lock "cinder-3930abf2-55d4-4aa2-9395-4adf1a03fd17-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:49:23 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-accfa455-198f-4e9c-9c1e-efcb2788bf7d tempest-VolumesTransfersV357Test-904592315 None] Acquiring lock "cinder-quobyte-3930abf2-55d4-4aa2-9395-4adf1a03fd17" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:49:23 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-accfa455-198f-4e9c-9c1e-efcb2788bf7d tempest-VolumesTransfersV357Test-904592315 None] Lock "cinder-quobyte-3930abf2-55d4-4aa2-9395-4adf1a03fd17" acquired by "delete_volume" :: waited 0.023s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:49:23 devstack sudo[86586]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:23 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-34c21766-3436-48e4-961c-7afa66c37729 tempest-VolumesTransfersV355Test-183142284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5a551a69-8197-4f80-b318-ea1456b5c382" returned: 0 in 0.758s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:23 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[7520936e-51e8-40a3-a4dd-4c8d154b8a24]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:49:23 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-accfa455-198f-4e9c-9c1e-efcb2788bf7d tempest-VolumesTransfersV357Test-904592315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-3930abf2-55d4-4aa2-9395-4adf1a03fd17 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:23 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-34c21766-3436-48e4-961c-7afa66c37729 tempest-VolumesTransfersV355Test-183142284 None] Lock "cinder-quobyte-5a551a69-8197-4f80-b318-ea1456b5c382" released by "delete_volume" :: held 1.561s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:49:23 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-34c21766-3436-48e4-961c-7afa66c37729 tempest-VolumesTransfersV355Test-183142284 None] Created reservations ['1d371a38-c45e-4204-903f-2be2b60b70db', '13ee1a18-02c1-4e7b-945e-e0cc2e753b1f', '4ef8599a-3d3d-4811-901c-ac270e882800', 'a72b4ae3-71a3-4151-89d4-6a24b8ef99e4'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:49:23 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-34c21766-3436-48e4-961c-7afa66c37729 tempest-VolumesTransfersV355Test-183142284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:49:23 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-34c21766-3436-48e4-961c-7afa66c37729 tempest-VolumesTransfersV355Test-183142284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:49:23 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-34c21766-3436-48e4-961c-7afa66c37729 tempest-VolumesTransfersV355Test-183142284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:49:23 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-34c21766-3436-48e4-961c-7afa66c37729 tempest-VolumesTransfersV355Test-183142284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:49:23 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-34c21766-3436-48e4-961c-7afa66c37729 tempest-VolumesTransfersV355Test-183142284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:49:23 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-34c21766-3436-48e4-961c-7afa66c37729 tempest-VolumesTransfersV355Test-183142284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:23 devstack sudo[86598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-3930abf2-55d4-4aa2-9395-4adf1a03fd17 Apr 24 13:49:23 devstack sudo[86598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:23 devstack sudo[86600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:49:23 devstack sudo[86600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:24 devstack sudo[86600]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-34c21766-3436-48e4-961c-7afa66c37729 tempest-VolumesTransfersV355Test-183142284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.744s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:24 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-34c21766-3436-48e4-961c-7afa66c37729 tempest-VolumesTransfersV355Test-183142284 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:49:24 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-34c21766-3436-48e4-961c-7afa66c37729 tempest-VolumesTransfersV355Test-183142284 None] Deleted volume successfully. Apr 24 13:49:24 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-34c21766-3436-48e4-961c-7afa66c37729 tempest-VolumesTransfersV355Test-183142284 None] Lock "cinder-5a551a69-8197-4f80-b318-ea1456b5c382-delete_volume" released by "delete_volume" :: held 2.648s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:49:24 devstack sudo[86598]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-accfa455-198f-4e9c-9c1e-efcb2788bf7d tempest-VolumesTransfersV357Test-904592315 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-3930abf2-55d4-4aa2-9395-4adf1a03fd17" returned: 0 in 1.097s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-accfa455-198f-4e9c-9c1e-efcb2788bf7d tempest-VolumesTransfersV357Test-904592315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-3930abf2-55d4-4aa2-9395-4adf1a03fd17 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:24 devstack sudo[86623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-3930abf2-55d4-4aa2-9395-4adf1a03fd17 Apr 24 13:49:24 devstack sudo[86623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:24 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-27361fe7-6c7f-4c38-9a93-33399d2c3ea7 tempest-VolumesTransfersV355Test-908611517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:49:24 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-27361fe7-6c7f-4c38-9a93-33399d2c3ea7 tempest-VolumesTransfersV355Test-908611517 None] Flow 'volume_create_manager' (6ee0ade6-8714-4630-985c-5b2214a7ecbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:49:24 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-27361fe7-6c7f-4c38-9a93-33399d2c3ea7 tempest-VolumesTransfersV355Test-908611517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64ca1e77-927b-44e3-bde5-9812351fdfdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:49:24 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-27361fe7-6c7f-4c38-9a93-33399d2c3ea7 tempest-VolumesTransfersV355Test-908611517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64ca1e77-927b-44e3-bde5-9812351fdfdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:49:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2141494024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af00c67a-db62-47f5-a9ee-2cccd2d4e2c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a5298c4f7af45799d6a48008dc3f1e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:49:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:49:25Z,use_quota=True,user_id='72ebfd64e1154ee29469729cd6f12345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:49:24 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-27361fe7-6c7f-4c38-9a93-33399d2c3ea7 tempest-VolumesTransfersV355Test-908611517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f45afba6-06fd-4c21-94ad-dd5c6f3f25ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:49:24 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-27361fe7-6c7f-4c38-9a93-33399d2c3ea7 tempest-VolumesTransfersV355Test-908611517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f45afba6-06fd-4c21-94ad-dd5c6f3f25ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:49:24 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-27361fe7-6c7f-4c38-9a93-33399d2c3ea7 tempest-VolumesTransfersV355Test-908611517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f227163e-9fb9-4b16-a4cd-de31b0aaac10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:49:24 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-27361fe7-6c7f-4c38-9a93-33399d2c3ea7 tempest-VolumesTransfersV355Test-908611517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f227163e-9fb9-4b16-a4cd-de31b0aaac10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af00c67a-db62-47f5-a9ee-2cccd2d4e2c9', 'volume_name': 'volume-af00c67a-db62-47f5-a9ee-2cccd2d4e2c9', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:49:24 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-27361fe7-6c7f-4c38-9a93-33399d2c3ea7 tempest-VolumesTransfersV355Test-908611517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2629e284-a321-4fe7-b4f2-2736d3a79eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:49:24 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-27361fe7-6c7f-4c38-9a93-33399d2c3ea7 tempest-VolumesTransfersV355Test-908611517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2629e284-a321-4fe7-b4f2-2736d3a79eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:49:24 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-27361fe7-6c7f-4c38-9a93-33399d2c3ea7 tempest-VolumesTransfersV355Test-908611517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f46eba4-a52c-4da0-915e-6ccde29e662e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:49:24 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-27361fe7-6c7f-4c38-9a93-33399d2c3ea7 tempest-VolumesTransfersV355Test-908611517 None] Volume af00c67a-db62-47f5-a9ee-2cccd2d4e2c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af00c67a-db62-47f5-a9ee-2cccd2d4e2c9', 'volume_size': 1} Apr 24 13:49:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-27361fe7-6c7f-4c38-9a93-33399d2c3ea7 tempest-VolumesTransfersV355Test-908611517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:49:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-27361fe7-6c7f-4c38-9a93-33399d2c3ea7 tempest-VolumesTransfersV355Test-908611517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:49:24 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-27361fe7-6c7f-4c38-9a93-33399d2c3ea7 tempest-VolumesTransfersV355Test-908611517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:49:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2141494024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af00c67a-db62-47f5-a9ee-2cccd2d4e2c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a5298c4f7af45799d6a48008dc3f1e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:49:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:49:25Z,use_quota=True,user_id='72ebfd64e1154ee29469729cd6f12345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:49:24 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-27361fe7-6c7f-4c38-9a93-33399d2c3ea7 tempest-VolumesTransfersV355Test-908611517 None] Creating volume af00c67a-db62-47f5-a9ee-2cccd2d4e2c9 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:49:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-27361fe7-6c7f-4c38-9a93-33399d2c3ea7 tempest-VolumesTransfersV355Test-908611517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:49:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-27361fe7-6c7f-4c38-9a93-33399d2c3ea7 tempest-VolumesTransfersV355Test-908611517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:49:24 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-27361fe7-6c7f-4c38-9a93-33399d2c3ea7 tempest-VolumesTransfersV355Test-908611517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:49:24 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-27361fe7-6c7f-4c38-9a93-33399d2c3ea7 tempest-VolumesTransfersV355Test-908611517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:49:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-27361fe7-6c7f-4c38-9a93-33399d2c3ea7 tempest-VolumesTransfersV355Test-908611517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:49:24 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-27361fe7-6c7f-4c38-9a93-33399d2c3ea7 tempest-VolumesTransfersV355Test-908611517 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:49:24 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-27361fe7-6c7f-4c38-9a93-33399d2c3ea7 tempest-VolumesTransfersV355Test-908611517 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:49:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-27361fe7-6c7f-4c38-9a93-33399d2c3ea7 tempest-VolumesTransfersV355Test-908611517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-af00c67a-db62-47f5-a9ee-2cccd2d4e2c9 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:24 devstack sudo[86625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-af00c67a-db62-47f5-a9ee-2cccd2d4e2c9 1073741824 Apr 24 13:49:24 devstack sudo[86625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:25 devstack sudo[86623]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:25 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-accfa455-198f-4e9c-9c1e-efcb2788bf7d tempest-VolumesTransfersV357Test-904592315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-3930abf2-55d4-4aa2-9395-4adf1a03fd17" returned: 0 in 0.613s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:25 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-accfa455-198f-4e9c-9c1e-efcb2788bf7d tempest-VolumesTransfersV357Test-904592315 None] Lock "cinder-quobyte-3930abf2-55d4-4aa2-9395-4adf1a03fd17" released by "delete_volume" :: held 1.783s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:49:25 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-accfa455-198f-4e9c-9c1e-efcb2788bf7d tempest-VolumesTransfersV357Test-904592315 None] Created reservations ['0baf3bad-aaea-4856-ae72-156663656560', '42719582-573c-4e83-947d-eff69c73a6bb', '71238ea0-079d-418a-9829-a6f7fcfa010f', 'db5a62b6-b791-465c-8774-49f05cda221f'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:49:25 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-accfa455-198f-4e9c-9c1e-efcb2788bf7d tempest-VolumesTransfersV357Test-904592315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:49:25 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-accfa455-198f-4e9c-9c1e-efcb2788bf7d tempest-VolumesTransfersV357Test-904592315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:49:25 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-accfa455-198f-4e9c-9c1e-efcb2788bf7d tempest-VolumesTransfersV357Test-904592315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:49:25 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-accfa455-198f-4e9c-9c1e-efcb2788bf7d tempest-VolumesTransfersV357Test-904592315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:49:25 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-accfa455-198f-4e9c-9c1e-efcb2788bf7d tempest-VolumesTransfersV357Test-904592315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:49:25 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-accfa455-198f-4e9c-9c1e-efcb2788bf7d tempest-VolumesTransfersV357Test-904592315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:25 devstack sudo[86635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:49:25 devstack sudo[86635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:25 devstack sudo[86625]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:25 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-27361fe7-6c7f-4c38-9a93-33399d2c3ea7 tempest-VolumesTransfersV355Test-908611517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-af00c67a-db62-47f5-a9ee-2cccd2d4e2c9 1073741824" returned: 0 in 1.133s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:25 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-27361fe7-6c7f-4c38-9a93-33399d2c3ea7 tempest-VolumesTransfersV355Test-908611517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-af00c67a-db62-47f5-a9ee-2cccd2d4e2c9 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:26 devstack sudo[86638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-af00c67a-db62-47f5-a9ee-2cccd2d4e2c9 Apr 24 13:49:26 devstack sudo[86638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:26 devstack sudo[86635]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-accfa455-198f-4e9c-9c1e-efcb2788bf7d tempest-VolumesTransfersV357Test-904592315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.901s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:26 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-accfa455-198f-4e9c-9c1e-efcb2788bf7d tempest-VolumesTransfersV357Test-904592315 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:49:26 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-accfa455-198f-4e9c-9c1e-efcb2788bf7d tempest-VolumesTransfersV357Test-904592315 None] Deleted volume successfully. Apr 24 13:49:26 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a2b924e-2f1b-4fa4-a76b-73a02323656e tempest-VolumesTransfersV357Test-1586561100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:49:26 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8a2b924e-2f1b-4fa4-a76b-73a02323656e tempest-VolumesTransfersV357Test-1586561100 None] Flow 'volume_create_manager' (5a685c9f-92f2-4e22-9c6a-7a36a4cc14c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:49:26 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8a2b924e-2f1b-4fa4-a76b-73a02323656e tempest-VolumesTransfersV357Test-1586561100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6858a2f3-b3b9-44f7-8dd6-9c8eb9955d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:49:26 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-accfa455-198f-4e9c-9c1e-efcb2788bf7d tempest-VolumesTransfersV357Test-904592315 None] Lock "cinder-3930abf2-55d4-4aa2-9395-4adf1a03fd17-delete_volume" released by "delete_volume" :: held 3.214s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:49:26 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8a2b924e-2f1b-4fa4-a76b-73a02323656e tempest-VolumesTransfersV357Test-1586561100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6858a2f3-b3b9-44f7-8dd6-9c8eb9955d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:49:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1664717599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d869606b-a9a8-4584-bff2-2e0c1338cd2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7da21aaf92004a3aa96f9a0ceece7634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:49:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:49:26Z,use_quota=True,user_id='f1861c64d8ec4b15899c1a143352f744',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:49:26 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8a2b924e-2f1b-4fa4-a76b-73a02323656e tempest-VolumesTransfersV357Test-1586561100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7c4c8dc-6123-449d-b3e9-3505e512ef14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:49:26 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8a2b924e-2f1b-4fa4-a76b-73a02323656e tempest-VolumesTransfersV357Test-1586561100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7c4c8dc-6123-449d-b3e9-3505e512ef14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:49:26 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8a2b924e-2f1b-4fa4-a76b-73a02323656e tempest-VolumesTransfersV357Test-1586561100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39d2e142-e82d-4571-9e94-cf8790c9d9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:49:26 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8a2b924e-2f1b-4fa4-a76b-73a02323656e tempest-VolumesTransfersV357Test-1586561100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39d2e142-e82d-4571-9e94-cf8790c9d9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd869606b-a9a8-4584-bff2-2e0c1338cd2f', 'volume_name': 'volume-d869606b-a9a8-4584-bff2-2e0c1338cd2f', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:49:26 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8a2b924e-2f1b-4fa4-a76b-73a02323656e tempest-VolumesTransfersV357Test-1586561100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (679207e2-6b0d-48b3-8d13-7ae42765cbf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:49:26 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8a2b924e-2f1b-4fa4-a76b-73a02323656e tempest-VolumesTransfersV357Test-1586561100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (679207e2-6b0d-48b3-8d13-7ae42765cbf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:49:26 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8a2b924e-2f1b-4fa4-a76b-73a02323656e tempest-VolumesTransfersV357Test-1586561100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (807d37d6-f455-4f78-960b-ef424f74647f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:49:26 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-8a2b924e-2f1b-4fa4-a76b-73a02323656e tempest-VolumesTransfersV357Test-1586561100 None] Volume d869606b-a9a8-4584-bff2-2e0c1338cd2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d869606b-a9a8-4584-bff2-2e0c1338cd2f', 'volume_size': 1} Apr 24 13:49:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-8a2b924e-2f1b-4fa4-a76b-73a02323656e tempest-VolumesTransfersV357Test-1586561100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:49:26 devstack sudo[86638]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-27361fe7-6c7f-4c38-9a93-33399d2c3ea7 tempest-VolumesTransfersV355Test-908611517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-af00c67a-db62-47f5-a9ee-2cccd2d4e2c9" returned: 0 in 0.908s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:26 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-27361fe7-6c7f-4c38-9a93-33399d2c3ea7 tempest-VolumesTransfersV355Test-908611517 None] <== create_volume: return (2163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:49:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-27361fe7-6c7f-4c38-9a93-33399d2c3ea7 tempest-VolumesTransfersV355Test-908611517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.166s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:49:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-8a2b924e-2f1b-4fa4-a76b-73a02323656e tempest-VolumesTransfersV357Test-1586561100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.296s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:49:26 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-8a2b924e-2f1b-4fa4-a76b-73a02323656e tempest-VolumesTransfersV357Test-1586561100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:49:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1664717599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d869606b-a9a8-4584-bff2-2e0c1338cd2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7da21aaf92004a3aa96f9a0ceece7634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:49:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:49:26Z,use_quota=True,user_id='f1861c64d8ec4b15899c1a143352f744',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:49:26 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-8a2b924e-2f1b-4fa4-a76b-73a02323656e tempest-VolumesTransfersV357Test-1586561100 None] Creating volume d869606b-a9a8-4584-bff2-2e0c1338cd2f {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:49:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-8a2b924e-2f1b-4fa4-a76b-73a02323656e tempest-VolumesTransfersV357Test-1586561100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:49:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-8a2b924e-2f1b-4fa4-a76b-73a02323656e tempest-VolumesTransfersV357Test-1586561100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:49:26 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-8a2b924e-2f1b-4fa4-a76b-73a02323656e tempest-VolumesTransfersV357Test-1586561100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:49:26 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-8a2b924e-2f1b-4fa4-a76b-73a02323656e tempest-VolumesTransfersV357Test-1586561100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:49:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-8a2b924e-2f1b-4fa4-a76b-73a02323656e tempest-VolumesTransfersV357Test-1586561100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:49:26 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-8a2b924e-2f1b-4fa4-a76b-73a02323656e tempest-VolumesTransfersV357Test-1586561100 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:49:26 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-8a2b924e-2f1b-4fa4-a76b-73a02323656e tempest-VolumesTransfersV357Test-1586561100 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:49:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8a2b924e-2f1b-4fa4-a76b-73a02323656e tempest-VolumesTransfersV357Test-1586561100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d869606b-a9a8-4584-bff2-2e0c1338cd2f 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:26 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-27361fe7-6c7f-4c38-9a93-33399d2c3ea7 tempest-VolumesTransfersV355Test-908611517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f46eba4-a52c-4da0-915e-6ccde29e662e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af00c67a-db62-47f5-a9ee-2cccd2d4e2c9', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:49:26 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-27361fe7-6c7f-4c38-9a93-33399d2c3ea7 tempest-VolumesTransfersV355Test-908611517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dbb3b8a-5af9-4a34-9bb2-27b52acce4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:49:26 devstack sudo[86644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d869606b-a9a8-4584-bff2-2e0c1338cd2f 1073741824 Apr 24 13:49:26 devstack sudo[86644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:26 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-27361fe7-6c7f-4c38-9a93-33399d2c3ea7 tempest-VolumesTransfersV355Test-908611517 None] Volume volume-af00c67a-db62-47f5-a9ee-2cccd2d4e2c9 (af00c67a-db62-47f5-a9ee-2cccd2d4e2c9): created successfully Apr 24 13:49:26 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-27361fe7-6c7f-4c38-9a93-33399d2c3ea7 tempest-VolumesTransfersV355Test-908611517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dbb3b8a-5af9-4a34-9bb2-27b52acce4c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:49:26 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-27361fe7-6c7f-4c38-9a93-33399d2c3ea7 tempest-VolumesTransfersV355Test-908611517 None] Flow 'volume_create_manager' (6ee0ade6-8714-4630-985c-5b2214a7ecbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:49:26 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-27361fe7-6c7f-4c38-9a93-33399d2c3ea7 tempest-VolumesTransfersV355Test-908611517 None] Created volume successfully. Apr 24 13:49:27 devstack cinder-volume[82046]: INFO cinder.volume.manager [req-1628d15f-dfd1-4ea7-8015-f08f6ea0621a req-3218474a-431b-4b59-ac05-eff208ef9d4e tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Terminate volume connection completed successfully. Apr 24 13:49:27 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [req-1628d15f-dfd1-4ea7-8015-f08f6ea0621a req-3218474a-431b-4b59-ac05-eff208ef9d4e tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Deleting attachment bf574621-131f-4a47-b613-15df4f703c6a. {{(pid=82046) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 24 13:49:27 devstack cinder-volume[82046]: DEBUG cinder.coordination [req-1628d15f-dfd1-4ea7-8015-f08f6ea0621a req-ffa945b5-ef5e-408c-b276-e21b39e0c2f4 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Acquiring lock "cinder-a2ed9936-b1c0-4ddf-bd6a-fc6713c3cb60-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:49:27 devstack cinder-volume[82046]: DEBUG cinder.coordination [req-1628d15f-dfd1-4ea7-8015-f08f6ea0621a req-ffa945b5-ef5e-408c-b276-e21b39e0c2f4 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Lock "cinder-a2ed9936-b1c0-4ddf-bd6a-fc6713c3cb60-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:49:27 devstack cinder-volume[82046]: DEBUG cinder.coordination [req-1628d15f-dfd1-4ea7-8015-f08f6ea0621a req-ffa945b5-ef5e-408c-b276-e21b39e0c2f4 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Acquiring lock "cinder-quobyte-a2ed9936-b1c0-4ddf-bd6a-fc6713c3cb60" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:49:27 devstack cinder-volume[82046]: DEBUG cinder.coordination [req-1628d15f-dfd1-4ea7-8015-f08f6ea0621a req-ffa945b5-ef5e-408c-b276-e21b39e0c2f4 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Lock "cinder-quobyte-a2ed9936-b1c0-4ddf-bd6a-fc6713c3cb60" acquired by "delete_volume" :: waited 0.026s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:49:27 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[34731a29-2f72-449b-8b00-f5a5f79dc524]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:49:27 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-1628d15f-dfd1-4ea7-8015-f08f6ea0621a req-ffa945b5-ef5e-408c-b276-e21b39e0c2f4 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a2ed9936-b1c0-4ddf-bd6a-fc6713c3cb60 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:27 devstack sudo[86644]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:27 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8a2b924e-2f1b-4fa4-a76b-73a02323656e tempest-VolumesTransfersV357Test-1586561100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d869606b-a9a8-4584-bff2-2e0c1338cd2f 1073741824" returned: 0 in 0.909s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:27 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8a2b924e-2f1b-4fa4-a76b-73a02323656e tempest-VolumesTransfersV357Test-1586561100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d869606b-a9a8-4584-bff2-2e0c1338cd2f {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:27 devstack sudo[86650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d869606b-a9a8-4584-bff2-2e0c1338cd2f Apr 24 13:49:27 devstack sudo[86650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:27 devstack sudo[86649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a2ed9936-b1c0-4ddf-bd6a-fc6713c3cb60 Apr 24 13:49:27 devstack sudo[86649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:28 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-4395b880-722b-4761-835b-fd4850c15a64 tempest-VolumesTransfersV355Test-183142284 None] Acquiring lock "cinder-af00c67a-db62-47f5-a9ee-2cccd2d4e2c9-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:49:28 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-4395b880-722b-4761-835b-fd4850c15a64 tempest-VolumesTransfersV355Test-183142284 None] Lock "cinder-af00c67a-db62-47f5-a9ee-2cccd2d4e2c9-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:49:28 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-4395b880-722b-4761-835b-fd4850c15a64 tempest-VolumesTransfersV355Test-183142284 None] Acquiring lock "cinder-quobyte-af00c67a-db62-47f5-a9ee-2cccd2d4e2c9" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:49:28 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-4395b880-722b-4761-835b-fd4850c15a64 tempest-VolumesTransfersV355Test-183142284 None] Lock "cinder-quobyte-af00c67a-db62-47f5-a9ee-2cccd2d4e2c9" acquired by "delete_volume" :: waited 0.021s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:49:28 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9630115-29f4-449b-aef4-80a6a61571bc]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:49:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4395b880-722b-4761-835b-fd4850c15a64 tempest-VolumesTransfersV355Test-183142284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-af00c67a-db62-47f5-a9ee-2cccd2d4e2c9 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:28 devstack sudo[86650]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8a2b924e-2f1b-4fa4-a76b-73a02323656e tempest-VolumesTransfersV357Test-1586561100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d869606b-a9a8-4584-bff2-2e0c1338cd2f" returned: 0 in 0.681s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:28 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-8a2b924e-2f1b-4fa4-a76b-73a02323656e tempest-VolumesTransfersV357Test-1586561100 None] <== create_volume: return (1651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:49:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-8a2b924e-2f1b-4fa4-a76b-73a02323656e tempest-VolumesTransfersV357Test-1586561100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:49:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8a2b924e-2f1b-4fa4-a76b-73a02323656e tempest-VolumesTransfersV357Test-1586561100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (807d37d6-f455-4f78-960b-ef424f74647f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d869606b-a9a8-4584-bff2-2e0c1338cd2f', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:49:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8a2b924e-2f1b-4fa4-a76b-73a02323656e tempest-VolumesTransfersV357Test-1586561100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5278aab-d0a9-4944-b4f0-7ccb3f5b3665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:49:28 devstack sudo[86654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-af00c67a-db62-47f5-a9ee-2cccd2d4e2c9 Apr 24 13:49:28 devstack sudo[86654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:28 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-8a2b924e-2f1b-4fa4-a76b-73a02323656e tempest-VolumesTransfersV357Test-1586561100 None] Volume volume-d869606b-a9a8-4584-bff2-2e0c1338cd2f (d869606b-a9a8-4584-bff2-2e0c1338cd2f): created successfully Apr 24 13:49:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8a2b924e-2f1b-4fa4-a76b-73a02323656e tempest-VolumesTransfersV357Test-1586561100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5278aab-d0a9-4944-b4f0-7ccb3f5b3665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:49:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8a2b924e-2f1b-4fa4-a76b-73a02323656e tempest-VolumesTransfersV357Test-1586561100 None] Flow 'volume_create_manager' (5a685c9f-92f2-4e22-9c6a-7a36a4cc14c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:49:28 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-8a2b924e-2f1b-4fa4-a76b-73a02323656e tempest-VolumesTransfersV357Test-1586561100 None] Created volume successfully. Apr 24 13:49:28 devstack sudo[86649]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-1628d15f-dfd1-4ea7-8015-f08f6ea0621a req-ffa945b5-ef5e-408c-b276-e21b39e0c2f4 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a2ed9936-b1c0-4ddf-bd6a-fc6713c3cb60" returned: 0 in 0.974s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-1628d15f-dfd1-4ea7-8015-f08f6ea0621a req-ffa945b5-ef5e-408c-b276-e21b39e0c2f4 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a2ed9936-b1c0-4ddf-bd6a-fc6713c3cb60 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:28 devstack sudo[86659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a2ed9936-b1c0-4ddf-bd6a-fc6713c3cb60 Apr 24 13:49:28 devstack sudo[86659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:29 devstack sudo[86654]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4395b880-722b-4761-835b-fd4850c15a64 tempest-VolumesTransfersV355Test-183142284 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-af00c67a-db62-47f5-a9ee-2cccd2d4e2c9" returned: 0 in 0.700s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4395b880-722b-4761-835b-fd4850c15a64 tempest-VolumesTransfersV355Test-183142284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-af00c67a-db62-47f5-a9ee-2cccd2d4e2c9 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:29 devstack sudo[86664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-af00c67a-db62-47f5-a9ee-2cccd2d4e2c9 Apr 24 13:49:29 devstack sudo[86664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:29 devstack sudo[86659]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-1628d15f-dfd1-4ea7-8015-f08f6ea0621a req-ffa945b5-ef5e-408c-b276-e21b39e0c2f4 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a2ed9936-b1c0-4ddf-bd6a-fc6713c3cb60" returned: 0 in 0.582s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:29 devstack cinder-volume[82046]: DEBUG cinder.coordination [req-1628d15f-dfd1-4ea7-8015-f08f6ea0621a req-ffa945b5-ef5e-408c-b276-e21b39e0c2f4 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Lock "cinder-quobyte-a2ed9936-b1c0-4ddf-bd6a-fc6713c3cb60" released by "delete_volume" :: held 1.632s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:49:29 devstack cinder-volume[82046]: DEBUG cinder.quota [req-1628d15f-dfd1-4ea7-8015-f08f6ea0621a req-ffa945b5-ef5e-408c-b276-e21b39e0c2f4 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Created reservations ['31de3906-cc04-4055-9350-6576c9f42d54', '3e8a6bf0-2719-4649-bcfb-dcdb5c9dbe71', '3b87154f-0821-4dc2-8b3b-8b1ce64d7739', '94a491e9-9fd0-4231-8687-aea5eb76b99a'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:49:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [req-1628d15f-dfd1-4ea7-8015-f08f6ea0621a req-ffa945b5-ef5e-408c-b276-e21b39e0c2f4 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:49:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [req-1628d15f-dfd1-4ea7-8015-f08f6ea0621a req-ffa945b5-ef5e-408c-b276-e21b39e0c2f4 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:49:29 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [req-1628d15f-dfd1-4ea7-8015-f08f6ea0621a req-ffa945b5-ef5e-408c-b276-e21b39e0c2f4 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:49:29 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [req-1628d15f-dfd1-4ea7-8015-f08f6ea0621a req-ffa945b5-ef5e-408c-b276-e21b39e0c2f4 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:49:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [req-1628d15f-dfd1-4ea7-8015-f08f6ea0621a req-ffa945b5-ef5e-408c-b276-e21b39e0c2f4 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:49:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-1628d15f-dfd1-4ea7-8015-f08f6ea0621a req-ffa945b5-ef5e-408c-b276-e21b39e0c2f4 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:29 devstack sudo[86667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:49:29 devstack sudo[86667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:29 devstack sudo[86664]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4395b880-722b-4761-835b-fd4850c15a64 tempest-VolumesTransfersV355Test-183142284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-af00c67a-db62-47f5-a9ee-2cccd2d4e2c9" returned: 0 in 0.816s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:29 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-4395b880-722b-4761-835b-fd4850c15a64 tempest-VolumesTransfersV355Test-183142284 None] Lock "cinder-quobyte-af00c67a-db62-47f5-a9ee-2cccd2d4e2c9" released by "delete_volume" :: held 1.576s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:49:30 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-4395b880-722b-4761-835b-fd4850c15a64 tempest-VolumesTransfersV355Test-183142284 None] Created reservations ['169a2d15-2bda-416f-a9ff-e5a25c1135a6', '0a0b417d-f387-472b-b026-25adadbbd617', '71771190-ecda-4da0-8aff-73e11ee7d9b0', '36f6a297-887e-44ff-a7c0-fc42228e88f7'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:49:30 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-c1c48cee-2e33-4727-8fab-15170222e9a8 tempest-VolumesTransfersV357Test-904592315 None] Acquiring lock "cinder-d869606b-a9a8-4584-bff2-2e0c1338cd2f-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:49:30 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-c1c48cee-2e33-4727-8fab-15170222e9a8 tempest-VolumesTransfersV357Test-904592315 None] Lock "cinder-d869606b-a9a8-4584-bff2-2e0c1338cd2f-delete_volume" acquired by "delete_volume" :: waited 0.113s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:49:30 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-c1c48cee-2e33-4727-8fab-15170222e9a8 tempest-VolumesTransfersV357Test-904592315 None] Acquiring lock "cinder-quobyte-d869606b-a9a8-4584-bff2-2e0c1338cd2f" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:49:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4395b880-722b-4761-835b-fd4850c15a64 tempest-VolumesTransfersV355Test-183142284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:49:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4395b880-722b-4761-835b-fd4850c15a64 tempest-VolumesTransfersV355Test-183142284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:49:30 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-4395b880-722b-4761-835b-fd4850c15a64 tempest-VolumesTransfersV355Test-183142284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:49:30 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-4395b880-722b-4761-835b-fd4850c15a64 tempest-VolumesTransfersV355Test-183142284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:49:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4395b880-722b-4761-835b-fd4850c15a64 tempest-VolumesTransfersV355Test-183142284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:49:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4395b880-722b-4761-835b-fd4850c15a64 tempest-VolumesTransfersV355Test-183142284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:30 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-c1c48cee-2e33-4727-8fab-15170222e9a8 tempest-VolumesTransfersV357Test-904592315 None] Lock "cinder-quobyte-d869606b-a9a8-4584-bff2-2e0c1338cd2f" acquired by "delete_volume" :: waited 0.063s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:49:30 devstack sudo[86670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:49:30 devstack sudo[86670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:30 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[68eb363d-c836-451f-b2a3-04dc431124c1]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:49:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-c1c48cee-2e33-4727-8fab-15170222e9a8 tempest-VolumesTransfersV357Test-904592315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d869606b-a9a8-4584-bff2-2e0c1338cd2f {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:30 devstack sudo[86672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d869606b-a9a8-4584-bff2-2e0c1338cd2f Apr 24 13:49:30 devstack sudo[86672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:30 devstack sudo[86667]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [req-1628d15f-dfd1-4ea7-8015-f08f6ea0621a req-ffa945b5-ef5e-408c-b276-e21b39e0c2f4 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.941s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:30 devstack cinder-volume[82046]: DEBUG cinder.manager [req-1628d15f-dfd1-4ea7-8015-f08f6ea0621a req-ffa945b5-ef5e-408c-b276-e21b39e0c2f4 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:49:30 devstack cinder-volume[82046]: INFO cinder.volume.manager [req-1628d15f-dfd1-4ea7-8015-f08f6ea0621a req-ffa945b5-ef5e-408c-b276-e21b39e0c2f4 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Deleted volume successfully. Apr 24 13:49:30 devstack cinder-volume[82046]: DEBUG cinder.coordination [req-1628d15f-dfd1-4ea7-8015-f08f6ea0621a req-ffa945b5-ef5e-408c-b276-e21b39e0c2f4 tempest-ServerBootFromVolumeStableRescueTest-9833111 None] Lock "cinder-a2ed9936-b1c0-4ddf-bd6a-fc6713c3cb60-delete_volume" released by "delete_volume" :: held 2.961s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:49:31 devstack sudo[86670]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4395b880-722b-4761-835b-fd4850c15a64 tempest-VolumesTransfersV355Test-183142284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.899s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:31 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-4395b880-722b-4761-835b-fd4850c15a64 tempest-VolumesTransfersV355Test-183142284 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:49:31 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-4395b880-722b-4761-835b-fd4850c15a64 tempest-VolumesTransfersV355Test-183142284 None] Deleted volume successfully. Apr 24 13:49:31 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-4395b880-722b-4761-835b-fd4850c15a64 tempest-VolumesTransfersV355Test-183142284 None] Lock "cinder-af00c67a-db62-47f5-a9ee-2cccd2d4e2c9-delete_volume" released by "delete_volume" :: held 2.968s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:49:31 devstack sudo[86672]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-c1c48cee-2e33-4727-8fab-15170222e9a8 tempest-VolumesTransfersV357Test-904592315 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d869606b-a9a8-4584-bff2-2e0c1338cd2f" returned: 0 in 1.129s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-c1c48cee-2e33-4727-8fab-15170222e9a8 tempest-VolumesTransfersV357Test-904592315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d869606b-a9a8-4584-bff2-2e0c1338cd2f {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:31 devstack sudo[86679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d869606b-a9a8-4584-bff2-2e0c1338cd2f Apr 24 13:49:31 devstack sudo[86679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:32 devstack sudo[86679]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-c1c48cee-2e33-4727-8fab-15170222e9a8 tempest-VolumesTransfersV357Test-904592315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d869606b-a9a8-4584-bff2-2e0c1338cd2f" returned: 0 in 0.793s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:32 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-c1c48cee-2e33-4727-8fab-15170222e9a8 tempest-VolumesTransfersV357Test-904592315 None] Lock "cinder-quobyte-d869606b-a9a8-4584-bff2-2e0c1338cd2f" released by "delete_volume" :: held 1.969s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:49:32 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-c1c48cee-2e33-4727-8fab-15170222e9a8 tempest-VolumesTransfersV357Test-904592315 None] Created reservations ['d81a314c-3010-4ce9-890a-3adf5afc05c3', 'a10bb8dd-0f2b-483f-9340-9c5f3b10213c', '88b5e6f9-88a2-4758-a66d-0072b1ed7f83', '7d424593-8db7-4959-977e-0c139e5b2972'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:49:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-c1c48cee-2e33-4727-8fab-15170222e9a8 tempest-VolumesTransfersV357Test-904592315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:49:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-c1c48cee-2e33-4727-8fab-15170222e9a8 tempest-VolumesTransfersV357Test-904592315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:49:32 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-c1c48cee-2e33-4727-8fab-15170222e9a8 tempest-VolumesTransfersV357Test-904592315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:49:32 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-c1c48cee-2e33-4727-8fab-15170222e9a8 tempest-VolumesTransfersV357Test-904592315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:49:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-c1c48cee-2e33-4727-8fab-15170222e9a8 tempest-VolumesTransfersV357Test-904592315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:49:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-c1c48cee-2e33-4727-8fab-15170222e9a8 tempest-VolumesTransfersV357Test-904592315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:32 devstack sudo[86684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:49:32 devstack sudo[86684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:33 devstack sudo[86684]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-c1c48cee-2e33-4727-8fab-15170222e9a8 tempest-VolumesTransfersV357Test-904592315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.756s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:33 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-c1c48cee-2e33-4727-8fab-15170222e9a8 tempest-VolumesTransfersV357Test-904592315 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:49:33 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-c1c48cee-2e33-4727-8fab-15170222e9a8 tempest-VolumesTransfersV357Test-904592315 None] Deleted volume successfully. Apr 24 13:49:33 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-c1c48cee-2e33-4727-8fab-15170222e9a8 tempest-VolumesTransfersV357Test-904592315 None] Lock "cinder-d869606b-a9a8-4584-bff2-2e0c1338cd2f-delete_volume" released by "delete_volume" :: held 3.131s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:49:37 devstack cinder-volume[82046]: DEBUG oslo_service.periodic_task [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82046) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 13:49:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:49:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:49:37 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:49:37 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:49:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:49:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:37 devstack sudo[86720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:49:37 devstack sudo[86720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:38 devstack sudo[86720]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.883s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:38 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:49:39 devstack cinder-volume[82046]: DEBUG dbcounter [-] [82046] Writing DB stats cinder:UPDATE=117,cinder:SELECT=91,cinder:DELETE=14,cinder:INSERT=23 {{(pid=82046) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 13:49:39 devstack cinder-volume[82046]: DEBUG dbcounter [-] [82046] Writing DB stats cinder:SELECT=100,cinder:INSERT=42,cinder:UPDATE=149,cinder:DELETE=9 {{(pid=82046) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 13:49:39 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3964d4c-4e4c-45fc-b5be-84fbbe8333cf tempest-VolumesCloneNegativeTest-230283944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:49:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c3964d4c-4e4c-45fc-b5be-84fbbe8333cf tempest-VolumesCloneNegativeTest-230283944 None] Flow 'volume_create_manager' (3bc4dd71-1f5b-4bcc-85c6-896bf1756346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:49:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c3964d4c-4e4c-45fc-b5be-84fbbe8333cf tempest-VolumesCloneNegativeTest-230283944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea04fa0e-7cde-4599-ac6a-09b4d8cf8882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:49:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c3964d4c-4e4c-45fc-b5be-84fbbe8333cf tempest-VolumesCloneNegativeTest-230283944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea04fa0e-7cde-4599-ac6a-09b4d8cf8882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:49:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1284325120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=392a1164-7c0b-4980-91a2-572695cdc882,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23e7c234a7e34b868a5b82a9dce13f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:49:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:49:40Z,use_quota=True,user_id='a85c5d53a6a243f88fc9ece8daeee48c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:49:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c3964d4c-4e4c-45fc-b5be-84fbbe8333cf tempest-VolumesCloneNegativeTest-230283944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64baf508-f27d-4491-a9dd-26639f1ce6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:49:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c3964d4c-4e4c-45fc-b5be-84fbbe8333cf tempest-VolumesCloneNegativeTest-230283944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64baf508-f27d-4491-a9dd-26639f1ce6ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:49:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c3964d4c-4e4c-45fc-b5be-84fbbe8333cf tempest-VolumesCloneNegativeTest-230283944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (782a743e-32b0-4d45-b638-76f873be2bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:49:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c3964d4c-4e4c-45fc-b5be-84fbbe8333cf tempest-VolumesCloneNegativeTest-230283944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (782a743e-32b0-4d45-b638-76f873be2bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '392a1164-7c0b-4980-91a2-572695cdc882', 'volume_name': 'volume-392a1164-7c0b-4980-91a2-572695cdc882', 'volume_size': 2}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:49:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c3964d4c-4e4c-45fc-b5be-84fbbe8333cf tempest-VolumesCloneNegativeTest-230283944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (519d2610-30ed-4265-8bd7-5ee2533a4a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:49:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c3964d4c-4e4c-45fc-b5be-84fbbe8333cf tempest-VolumesCloneNegativeTest-230283944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (519d2610-30ed-4265-8bd7-5ee2533a4a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:49:40 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c3964d4c-4e4c-45fc-b5be-84fbbe8333cf tempest-VolumesCloneNegativeTest-230283944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09dc1815-f95b-46e2-b0a9-e6afd64c3934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:49:40 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-c3964d4c-4e4c-45fc-b5be-84fbbe8333cf tempest-VolumesCloneNegativeTest-230283944 None] Volume 392a1164-7c0b-4980-91a2-572695cdc882: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-392a1164-7c0b-4980-91a2-572695cdc882', 'volume_size': 2} Apr 24 13:49:40 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-c3964d4c-4e4c-45fc-b5be-84fbbe8333cf tempest-VolumesCloneNegativeTest-230283944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:49:40 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-c3964d4c-4e4c-45fc-b5be-84fbbe8333cf tempest-VolumesCloneNegativeTest-230283944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:49:40 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-c3964d4c-4e4c-45fc-b5be-84fbbe8333cf tempest-VolumesCloneNegativeTest-230283944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:49:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1284325120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=392a1164-7c0b-4980-91a2-572695cdc882,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23e7c234a7e34b868a5b82a9dce13f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:49:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:49:40Z,use_quota=True,user_id='a85c5d53a6a243f88fc9ece8daeee48c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:49:40 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-c3964d4c-4e4c-45fc-b5be-84fbbe8333cf tempest-VolumesCloneNegativeTest-230283944 None] Creating volume 392a1164-7c0b-4980-91a2-572695cdc882 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:49:40 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-c3964d4c-4e4c-45fc-b5be-84fbbe8333cf tempest-VolumesCloneNegativeTest-230283944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:49:40 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-c3964d4c-4e4c-45fc-b5be-84fbbe8333cf tempest-VolumesCloneNegativeTest-230283944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:49:40 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-c3964d4c-4e4c-45fc-b5be-84fbbe8333cf tempest-VolumesCloneNegativeTest-230283944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:49:40 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-c3964d4c-4e4c-45fc-b5be-84fbbe8333cf tempest-VolumesCloneNegativeTest-230283944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:49:40 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-c3964d4c-4e4c-45fc-b5be-84fbbe8333cf tempest-VolumesCloneNegativeTest-230283944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:49:40 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-c3964d4c-4e4c-45fc-b5be-84fbbe8333cf tempest-VolumesCloneNegativeTest-230283944 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:49:40 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-c3964d4c-4e4c-45fc-b5be-84fbbe8333cf tempest-VolumesCloneNegativeTest-230283944 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:49:40 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-c3964d4c-4e4c-45fc-b5be-84fbbe8333cf tempest-VolumesCloneNegativeTest-230283944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-392a1164-7c0b-4980-91a2-572695cdc882 2147483648 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:40 devstack sudo[86723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-392a1164-7c0b-4980-91a2-572695cdc882 2147483648 Apr 24 13:49:40 devstack sudo[86723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:40 devstack sudo[86723]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:40 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-c3964d4c-4e4c-45fc-b5be-84fbbe8333cf tempest-VolumesCloneNegativeTest-230283944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-392a1164-7c0b-4980-91a2-572695cdc882 2147483648" returned: 0 in 0.980s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-c3964d4c-4e4c-45fc-b5be-84fbbe8333cf tempest-VolumesCloneNegativeTest-230283944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-392a1164-7c0b-4980-91a2-572695cdc882 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:41 devstack sudo[86728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-392a1164-7c0b-4980-91a2-572695cdc882 Apr 24 13:49:41 devstack sudo[86728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:41 devstack sudo[86728]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-c3964d4c-4e4c-45fc-b5be-84fbbe8333cf tempest-VolumesCloneNegativeTest-230283944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-392a1164-7c0b-4980-91a2-572695cdc882" returned: 0 in 0.599s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:41 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-c3964d4c-4e4c-45fc-b5be-84fbbe8333cf tempest-VolumesCloneNegativeTest-230283944 None] <== create_volume: return (1632ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:49:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-c3964d4c-4e4c-45fc-b5be-84fbbe8333cf tempest-VolumesCloneNegativeTest-230283944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:49:41 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c3964d4c-4e4c-45fc-b5be-84fbbe8333cf tempest-VolumesCloneNegativeTest-230283944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09dc1815-f95b-46e2-b0a9-e6afd64c3934) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-392a1164-7c0b-4980-91a2-572695cdc882', 'volume_size': 2}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:49:41 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c3964d4c-4e4c-45fc-b5be-84fbbe8333cf tempest-VolumesCloneNegativeTest-230283944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9416d5d5-f7a0-42fb-8d24-89a04b10cfc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:49:41 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-c3964d4c-4e4c-45fc-b5be-84fbbe8333cf tempest-VolumesCloneNegativeTest-230283944 None] Volume volume-392a1164-7c0b-4980-91a2-572695cdc882 (392a1164-7c0b-4980-91a2-572695cdc882): created successfully Apr 24 13:49:41 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c3964d4c-4e4c-45fc-b5be-84fbbe8333cf tempest-VolumesCloneNegativeTest-230283944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9416d5d5-f7a0-42fb-8d24-89a04b10cfc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:49:41 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c3964d4c-4e4c-45fc-b5be-84fbbe8333cf tempest-VolumesCloneNegativeTest-230283944 None] Flow 'volume_create_manager' (3bc4dd71-1f5b-4bcc-85c6-896bf1756346) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:49:41 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-c3964d4c-4e4c-45fc-b5be-84fbbe8333cf tempest-VolumesCloneNegativeTest-230283944 None] Created volume successfully. Apr 24 13:49:42 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-a8d0f9a8-a903-4d77-9099-52ee90a0f6a6 tempest-VolumesCloneNegativeTest-230283944 None] Acquiring lock "cinder-392a1164-7c0b-4980-91a2-572695cdc882-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:49:42 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-a8d0f9a8-a903-4d77-9099-52ee90a0f6a6 tempest-VolumesCloneNegativeTest-230283944 None] Lock "cinder-392a1164-7c0b-4980-91a2-572695cdc882-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:49:42 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-a8d0f9a8-a903-4d77-9099-52ee90a0f6a6 tempest-VolumesCloneNegativeTest-230283944 None] Acquiring lock "cinder-quobyte-392a1164-7c0b-4980-91a2-572695cdc882" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:49:42 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-a8d0f9a8-a903-4d77-9099-52ee90a0f6a6 tempest-VolumesCloneNegativeTest-230283944 None] Lock "cinder-quobyte-392a1164-7c0b-4980-91a2-572695cdc882" acquired by "delete_volume" :: waited 0.020s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:49:42 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[602f82eb-1ad9-4304-8ca3-71f20f7708ce]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:49:42 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a8d0f9a8-a903-4d77-9099-52ee90a0f6a6 tempest-VolumesCloneNegativeTest-230283944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-392a1164-7c0b-4980-91a2-572695cdc882 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:42 devstack sudo[86731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-392a1164-7c0b-4980-91a2-572695cdc882 Apr 24 13:49:42 devstack sudo[86731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:43 devstack sudo[86731]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a8d0f9a8-a903-4d77-9099-52ee90a0f6a6 tempest-VolumesCloneNegativeTest-230283944 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-392a1164-7c0b-4980-91a2-572695cdc882" returned: 0 in 0.881s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a8d0f9a8-a903-4d77-9099-52ee90a0f6a6 tempest-VolumesCloneNegativeTest-230283944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-392a1164-7c0b-4980-91a2-572695cdc882 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:43 devstack sudo[86736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-392a1164-7c0b-4980-91a2-572695cdc882 Apr 24 13:49:43 devstack sudo[86736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:44 devstack sudo[86736]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a8d0f9a8-a903-4d77-9099-52ee90a0f6a6 tempest-VolumesCloneNegativeTest-230283944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-392a1164-7c0b-4980-91a2-572695cdc882" returned: 0 in 0.941s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:44 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-a8d0f9a8-a903-4d77-9099-52ee90a0f6a6 tempest-VolumesCloneNegativeTest-230283944 None] Lock "cinder-quobyte-392a1164-7c0b-4980-91a2-572695cdc882" released by "delete_volume" :: held 1.886s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:49:44 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-a8d0f9a8-a903-4d77-9099-52ee90a0f6a6 tempest-VolumesCloneNegativeTest-230283944 None] Created reservations ['0caad8e3-a061-4b74-bdea-35ffbe320d70', '24cc71e8-5a7d-4f29-b55b-8579af608606', '1ce1159b-425d-431a-bf97-2223bbf4c3ec', 'ac30ccc7-b48c-4a32-aef2-9b20190cb3ee'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:49:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a8d0f9a8-a903-4d77-9099-52ee90a0f6a6 tempest-VolumesCloneNegativeTest-230283944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:49:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a8d0f9a8-a903-4d77-9099-52ee90a0f6a6 tempest-VolumesCloneNegativeTest-230283944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:49:44 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a8d0f9a8-a903-4d77-9099-52ee90a0f6a6 tempest-VolumesCloneNegativeTest-230283944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:49:44 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a8d0f9a8-a903-4d77-9099-52ee90a0f6a6 tempest-VolumesCloneNegativeTest-230283944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:49:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a8d0f9a8-a903-4d77-9099-52ee90a0f6a6 tempest-VolumesCloneNegativeTest-230283944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:49:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a8d0f9a8-a903-4d77-9099-52ee90a0f6a6 tempest-VolumesCloneNegativeTest-230283944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:44 devstack sudo[86740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:49:44 devstack sudo[86740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:45 devstack sudo[86740]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a8d0f9a8-a903-4d77-9099-52ee90a0f6a6 tempest-VolumesCloneNegativeTest-230283944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.779s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:45 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-a8d0f9a8-a903-4d77-9099-52ee90a0f6a6 tempest-VolumesCloneNegativeTest-230283944 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:49:45 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-a8d0f9a8-a903-4d77-9099-52ee90a0f6a6 tempest-VolumesCloneNegativeTest-230283944 None] Deleted volume successfully. Apr 24 13:49:45 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-a8d0f9a8-a903-4d77-9099-52ee90a0f6a6 tempest-VolumesCloneNegativeTest-230283944 None] Lock "cinder-392a1164-7c0b-4980-91a2-572695cdc882-delete_volume" released by "delete_volume" :: held 3.072s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:49:53 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a562ae5-1aa6-47c7-9599-1c54edefcadc tempest-VolumesListTestJSON-944646595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:49:53 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-2a562ae5-1aa6-47c7-9599-1c54edefcadc tempest-VolumesListTestJSON-944646595 None] Flow 'volume_create_manager' (74982ddd-64e5-41ac-8992-6ef9b2abc273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:49:53 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-2a562ae5-1aa6-47c7-9599-1c54edefcadc tempest-VolumesListTestJSON-944646595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d11db3eb-6995-4bfd-9d8a-b02670d675c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:49:53 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-2a562ae5-1aa6-47c7-9599-1c54edefcadc tempest-VolumesListTestJSON-944646595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d11db3eb-6995-4bfd-9d8a-b02670d675c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:49:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-842534387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=015693fb-0f32-4814-8ba9-64801b7b0761,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3d21feeaae5f47d997622acd621eff6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:49:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:49:53Z,use_quota=True,user_id='2d2e4a30152041d78518caf07d049244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:49:53 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-2a562ae5-1aa6-47c7-9599-1c54edefcadc tempest-VolumesListTestJSON-944646595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62fbdbb6-33a9-4bcc-bbb2-e5351755c947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:49:53 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-2a562ae5-1aa6-47c7-9599-1c54edefcadc tempest-VolumesListTestJSON-944646595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62fbdbb6-33a9-4bcc-bbb2-e5351755c947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:49:53 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-2a562ae5-1aa6-47c7-9599-1c54edefcadc tempest-VolumesListTestJSON-944646595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0e05809-c5b5-4886-b186-293dc6608905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:49:53 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-2a562ae5-1aa6-47c7-9599-1c54edefcadc tempest-VolumesListTestJSON-944646595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0e05809-c5b5-4886-b186-293dc6608905) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '015693fb-0f32-4814-8ba9-64801b7b0761', 'volume_name': 'volume-015693fb-0f32-4814-8ba9-64801b7b0761', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:49:53 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-2a562ae5-1aa6-47c7-9599-1c54edefcadc tempest-VolumesListTestJSON-944646595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e2176c9-2b20-4f51-af79-932a9c8041ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:49:53 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-2a562ae5-1aa6-47c7-9599-1c54edefcadc tempest-VolumesListTestJSON-944646595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e2176c9-2b20-4f51-af79-932a9c8041ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:49:53 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-2a562ae5-1aa6-47c7-9599-1c54edefcadc tempest-VolumesListTestJSON-944646595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c8d6889-b80d-4265-9f64-480c9fcb9b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:49:53 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-2a562ae5-1aa6-47c7-9599-1c54edefcadc tempest-VolumesListTestJSON-944646595 None] Volume 015693fb-0f32-4814-8ba9-64801b7b0761: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-015693fb-0f32-4814-8ba9-64801b7b0761', 'volume_size': 1} Apr 24 13:49:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-2a562ae5-1aa6-47c7-9599-1c54edefcadc tempest-VolumesListTestJSON-944646595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:49:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-2a562ae5-1aa6-47c7-9599-1c54edefcadc tempest-VolumesListTestJSON-944646595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:49:53 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-2a562ae5-1aa6-47c7-9599-1c54edefcadc tempest-VolumesListTestJSON-944646595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:49:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-842534387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=015693fb-0f32-4814-8ba9-64801b7b0761,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3d21feeaae5f47d997622acd621eff6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:49:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:49:53Z,use_quota=True,user_id='2d2e4a30152041d78518caf07d049244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:49:53 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-2a562ae5-1aa6-47c7-9599-1c54edefcadc tempest-VolumesListTestJSON-944646595 None] Creating volume 015693fb-0f32-4814-8ba9-64801b7b0761 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:49:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-2a562ae5-1aa6-47c7-9599-1c54edefcadc tempest-VolumesListTestJSON-944646595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:49:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-2a562ae5-1aa6-47c7-9599-1c54edefcadc tempest-VolumesListTestJSON-944646595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:49:53 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-2a562ae5-1aa6-47c7-9599-1c54edefcadc tempest-VolumesListTestJSON-944646595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:49:53 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-2a562ae5-1aa6-47c7-9599-1c54edefcadc tempest-VolumesListTestJSON-944646595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:49:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-2a562ae5-1aa6-47c7-9599-1c54edefcadc tempest-VolumesListTestJSON-944646595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:49:53 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-2a562ae5-1aa6-47c7-9599-1c54edefcadc tempest-VolumesListTestJSON-944646595 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:49:53 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-2a562ae5-1aa6-47c7-9599-1c54edefcadc tempest-VolumesListTestJSON-944646595 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:49:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2a562ae5-1aa6-47c7-9599-1c54edefcadc tempest-VolumesListTestJSON-944646595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-015693fb-0f32-4814-8ba9-64801b7b0761 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:53 devstack sudo[86756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-015693fb-0f32-4814-8ba9-64801b7b0761 1073741824 Apr 24 13:49:53 devstack sudo[86756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:54 devstack sudo[86756]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:54 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2a562ae5-1aa6-47c7-9599-1c54edefcadc tempest-VolumesListTestJSON-944646595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-015693fb-0f32-4814-8ba9-64801b7b0761 1073741824" returned: 0 in 1.013s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:54 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2a562ae5-1aa6-47c7-9599-1c54edefcadc tempest-VolumesListTestJSON-944646595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-015693fb-0f32-4814-8ba9-64801b7b0761 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:54 devstack sudo[86762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-015693fb-0f32-4814-8ba9-64801b7b0761 Apr 24 13:49:54 devstack sudo[86762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:55 devstack sudo[86762]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:55 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2a562ae5-1aa6-47c7-9599-1c54edefcadc tempest-VolumesListTestJSON-944646595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-015693fb-0f32-4814-8ba9-64801b7b0761" returned: 0 in 0.711s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:55 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-2a562ae5-1aa6-47c7-9599-1c54edefcadc tempest-VolumesListTestJSON-944646595 None] <== create_volume: return (1803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:49:55 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-2a562ae5-1aa6-47c7-9599-1c54edefcadc tempest-VolumesListTestJSON-944646595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.809s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:49:55 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-2a562ae5-1aa6-47c7-9599-1c54edefcadc tempest-VolumesListTestJSON-944646595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c8d6889-b80d-4265-9f64-480c9fcb9b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-015693fb-0f32-4814-8ba9-64801b7b0761', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:49:55 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-2a562ae5-1aa6-47c7-9599-1c54edefcadc tempest-VolumesListTestJSON-944646595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ade4e5a5-ea9e-4456-b0d4-dd01dce12688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:49:55 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-2a562ae5-1aa6-47c7-9599-1c54edefcadc tempest-VolumesListTestJSON-944646595 None] Volume volume-015693fb-0f32-4814-8ba9-64801b7b0761 (015693fb-0f32-4814-8ba9-64801b7b0761): created successfully Apr 24 13:49:55 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-2a562ae5-1aa6-47c7-9599-1c54edefcadc tempest-VolumesListTestJSON-944646595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ade4e5a5-ea9e-4456-b0d4-dd01dce12688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:49:55 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-2a562ae5-1aa6-47c7-9599-1c54edefcadc tempest-VolumesListTestJSON-944646595 None] Flow 'volume_create_manager' (74982ddd-64e5-41ac-8992-6ef9b2abc273) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:49:55 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-2a562ae5-1aa6-47c7-9599-1c54edefcadc tempest-VolumesListTestJSON-944646595 None] Created volume successfully. Apr 24 13:49:56 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-91888c8d-1c96-4952-aad9-893264435a14 tempest-VolumesListTestJSON-944646595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:49:56 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-91888c8d-1c96-4952-aad9-893264435a14 tempest-VolumesListTestJSON-944646595 None] Flow 'volume_create_manager' (a7c6adc4-7562-415f-9a1f-595eaca84dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:49:56 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-91888c8d-1c96-4952-aad9-893264435a14 tempest-VolumesListTestJSON-944646595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c671ee67-ac10-4a62-b17a-210e5145b0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:49:56 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-91888c8d-1c96-4952-aad9-893264435a14 tempest-VolumesListTestJSON-944646595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c671ee67-ac10-4a62-b17a-210e5145b0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:49:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-783637975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bc5d65e-ac02-4aea-8772-ff17c8b9432a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3d21feeaae5f47d997622acd621eff6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:49:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:49:56Z,use_quota=True,user_id='2d2e4a30152041d78518caf07d049244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:49:56 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-91888c8d-1c96-4952-aad9-893264435a14 tempest-VolumesListTestJSON-944646595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4619012-2d8f-4046-9fd1-9c73ed4ede9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:49:56 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-91888c8d-1c96-4952-aad9-893264435a14 tempest-VolumesListTestJSON-944646595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4619012-2d8f-4046-9fd1-9c73ed4ede9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:49:56 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-91888c8d-1c96-4952-aad9-893264435a14 tempest-VolumesListTestJSON-944646595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e92aff4-1bcd-4c4c-aeef-2ac9d9f65afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:49:56 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-91888c8d-1c96-4952-aad9-893264435a14 tempest-VolumesListTestJSON-944646595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e92aff4-1bcd-4c4c-aeef-2ac9d9f65afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bc5d65e-ac02-4aea-8772-ff17c8b9432a', 'volume_name': 'volume-9bc5d65e-ac02-4aea-8772-ff17c8b9432a', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:49:56 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-91888c8d-1c96-4952-aad9-893264435a14 tempest-VolumesListTestJSON-944646595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2c5bce8-e884-416b-aa66-3a77898de9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:49:56 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-91888c8d-1c96-4952-aad9-893264435a14 tempest-VolumesListTestJSON-944646595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2c5bce8-e884-416b-aa66-3a77898de9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:49:56 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-91888c8d-1c96-4952-aad9-893264435a14 tempest-VolumesListTestJSON-944646595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9301edb-cc9a-4457-8762-2fd5b762f42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:49:56 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-91888c8d-1c96-4952-aad9-893264435a14 tempest-VolumesListTestJSON-944646595 None] Volume 9bc5d65e-ac02-4aea-8772-ff17c8b9432a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bc5d65e-ac02-4aea-8772-ff17c8b9432a', 'volume_size': 1} Apr 24 13:49:56 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-91888c8d-1c96-4952-aad9-893264435a14 tempest-VolumesListTestJSON-944646595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:49:56 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-91888c8d-1c96-4952-aad9-893264435a14 tempest-VolumesListTestJSON-944646595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:49:56 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-91888c8d-1c96-4952-aad9-893264435a14 tempest-VolumesListTestJSON-944646595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:49:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-783637975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bc5d65e-ac02-4aea-8772-ff17c8b9432a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3d21feeaae5f47d997622acd621eff6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:49:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:49:56Z,use_quota=True,user_id='2d2e4a30152041d78518caf07d049244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:49:56 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-91888c8d-1c96-4952-aad9-893264435a14 tempest-VolumesListTestJSON-944646595 None] Creating volume 9bc5d65e-ac02-4aea-8772-ff17c8b9432a {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:49:56 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-91888c8d-1c96-4952-aad9-893264435a14 tempest-VolumesListTestJSON-944646595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:49:56 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-91888c8d-1c96-4952-aad9-893264435a14 tempest-VolumesListTestJSON-944646595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:49:56 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-91888c8d-1c96-4952-aad9-893264435a14 tempest-VolumesListTestJSON-944646595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:49:56 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-91888c8d-1c96-4952-aad9-893264435a14 tempest-VolumesListTestJSON-944646595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:49:56 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-91888c8d-1c96-4952-aad9-893264435a14 tempest-VolumesListTestJSON-944646595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:49:56 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-91888c8d-1c96-4952-aad9-893264435a14 tempest-VolumesListTestJSON-944646595 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:49:56 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-91888c8d-1c96-4952-aad9-893264435a14 tempest-VolumesListTestJSON-944646595 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:49:56 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-91888c8d-1c96-4952-aad9-893264435a14 tempest-VolumesListTestJSON-944646595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bc5d65e-ac02-4aea-8772-ff17c8b9432a 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:56 devstack sudo[86767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bc5d65e-ac02-4aea-8772-ff17c8b9432a 1073741824 Apr 24 13:49:56 devstack sudo[86767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:57 devstack sudo[86767]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:57 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-91888c8d-1c96-4952-aad9-893264435a14 tempest-VolumesListTestJSON-944646595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bc5d65e-ac02-4aea-8772-ff17c8b9432a 1073741824" returned: 0 in 0.921s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:57 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-91888c8d-1c96-4952-aad9-893264435a14 tempest-VolumesListTestJSON-944646595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bc5d65e-ac02-4aea-8772-ff17c8b9432a {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:57 devstack sudo[86772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bc5d65e-ac02-4aea-8772-ff17c8b9432a Apr 24 13:49:57 devstack sudo[86772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:49:58 devstack sudo[86772]: pam_unix(sudo:session): session closed for user root Apr 24 13:49:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-91888c8d-1c96-4952-aad9-893264435a14 tempest-VolumesListTestJSON-944646595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bc5d65e-ac02-4aea-8772-ff17c8b9432a" returned: 0 in 0.681s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:49:58 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-91888c8d-1c96-4952-aad9-893264435a14 tempest-VolumesListTestJSON-944646595 None] <== create_volume: return (1656ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:49:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-91888c8d-1c96-4952-aad9-893264435a14 tempest-VolumesListTestJSON-944646595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.659s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:49:58 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-91888c8d-1c96-4952-aad9-893264435a14 tempest-VolumesListTestJSON-944646595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9301edb-cc9a-4457-8762-2fd5b762f42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bc5d65e-ac02-4aea-8772-ff17c8b9432a', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:49:58 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-91888c8d-1c96-4952-aad9-893264435a14 tempest-VolumesListTestJSON-944646595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00f0c0bc-5f07-49fe-b5bc-59db5cdae302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:49:58 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-91888c8d-1c96-4952-aad9-893264435a14 tempest-VolumesListTestJSON-944646595 None] Volume volume-9bc5d65e-ac02-4aea-8772-ff17c8b9432a (9bc5d65e-ac02-4aea-8772-ff17c8b9432a): created successfully Apr 24 13:49:58 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-91888c8d-1c96-4952-aad9-893264435a14 tempest-VolumesListTestJSON-944646595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00f0c0bc-5f07-49fe-b5bc-59db5cdae302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:49:58 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-91888c8d-1c96-4952-aad9-893264435a14 tempest-VolumesListTestJSON-944646595 None] Flow 'volume_create_manager' (a7c6adc4-7562-415f-9a1f-595eaca84dd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:49:58 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-91888c8d-1c96-4952-aad9-893264435a14 tempest-VolumesListTestJSON-944646595 None] Created volume successfully. Apr 24 13:49:59 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-c02d8960-66dd-40bb-8304-431d18e59fa0 tempest-VolumesListTestJSON-944646595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:49:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c02d8960-66dd-40bb-8304-431d18e59fa0 tempest-VolumesListTestJSON-944646595 None] Flow 'volume_create_manager' (6a34d961-c818-43a2-a964-7ddb3aad8a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:49:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c02d8960-66dd-40bb-8304-431d18e59fa0 tempest-VolumesListTestJSON-944646595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28950a5b-d702-4ecb-a1d5-9b7ddf022494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:49:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c02d8960-66dd-40bb-8304-431d18e59fa0 tempest-VolumesListTestJSON-944646595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28950a5b-d702-4ecb-a1d5-9b7ddf022494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-566810469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9a88624-e6d3-44e3-b511-82fca8139041,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3d21feeaae5f47d997622acd621eff6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:49:59Z,use_quota=True,user_id='2d2e4a30152041d78518caf07d049244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:49:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c02d8960-66dd-40bb-8304-431d18e59fa0 tempest-VolumesListTestJSON-944646595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7c8053e-da94-4cae-add9-5b7b30c55447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:49:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c02d8960-66dd-40bb-8304-431d18e59fa0 tempest-VolumesListTestJSON-944646595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7c8053e-da94-4cae-add9-5b7b30c55447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:49:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c02d8960-66dd-40bb-8304-431d18e59fa0 tempest-VolumesListTestJSON-944646595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ad4549d-dabb-423f-8a41-fd89d8ca0fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:49:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c02d8960-66dd-40bb-8304-431d18e59fa0 tempest-VolumesListTestJSON-944646595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ad4549d-dabb-423f-8a41-fd89d8ca0fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9a88624-e6d3-44e3-b511-82fca8139041', 'volume_name': 'volume-d9a88624-e6d3-44e3-b511-82fca8139041', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:49:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c02d8960-66dd-40bb-8304-431d18e59fa0 tempest-VolumesListTestJSON-944646595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0d99f24-87a9-4992-a487-cba868caf1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:49:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c02d8960-66dd-40bb-8304-431d18e59fa0 tempest-VolumesListTestJSON-944646595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0d99f24-87a9-4992-a487-cba868caf1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:49:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c02d8960-66dd-40bb-8304-431d18e59fa0 tempest-VolumesListTestJSON-944646595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e72c729e-61c2-4bfb-8012-8b16fc61f8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:49:59 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-c02d8960-66dd-40bb-8304-431d18e59fa0 tempest-VolumesListTestJSON-944646595 None] Volume d9a88624-e6d3-44e3-b511-82fca8139041: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9a88624-e6d3-44e3-b511-82fca8139041', 'volume_size': 1} Apr 24 13:49:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-c02d8960-66dd-40bb-8304-431d18e59fa0 tempest-VolumesListTestJSON-944646595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:49:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-c02d8960-66dd-40bb-8304-431d18e59fa0 tempest-VolumesListTestJSON-944646595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:49:59 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-c02d8960-66dd-40bb-8304-431d18e59fa0 tempest-VolumesListTestJSON-944646595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-566810469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9a88624-e6d3-44e3-b511-82fca8139041,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3d21feeaae5f47d997622acd621eff6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:49:59Z,use_quota=True,user_id='2d2e4a30152041d78518caf07d049244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:49:59 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-c02d8960-66dd-40bb-8304-431d18e59fa0 tempest-VolumesListTestJSON-944646595 None] Creating volume d9a88624-e6d3-44e3-b511-82fca8139041 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:49:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-c02d8960-66dd-40bb-8304-431d18e59fa0 tempest-VolumesListTestJSON-944646595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:49:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-c02d8960-66dd-40bb-8304-431d18e59fa0 tempest-VolumesListTestJSON-944646595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:49:59 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-c02d8960-66dd-40bb-8304-431d18e59fa0 tempest-VolumesListTestJSON-944646595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:49:59 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-c02d8960-66dd-40bb-8304-431d18e59fa0 tempest-VolumesListTestJSON-944646595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:49:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-c02d8960-66dd-40bb-8304-431d18e59fa0 tempest-VolumesListTestJSON-944646595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:49:59 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-c02d8960-66dd-40bb-8304-431d18e59fa0 tempest-VolumesListTestJSON-944646595 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:49:59 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-c02d8960-66dd-40bb-8304-431d18e59fa0 tempest-VolumesListTestJSON-944646595 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:49:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-c02d8960-66dd-40bb-8304-431d18e59fa0 tempest-VolumesListTestJSON-944646595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d9a88624-e6d3-44e3-b511-82fca8139041 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:49:59 devstack sudo[86775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d9a88624-e6d3-44e3-b511-82fca8139041 1073741824 Apr 24 13:49:59 devstack sudo[86775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:50:00 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-8189f7b8-f814-499d-8843-9d8d58320d24 tempest-VolumesActionsTest-1194041985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:50:00 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8189f7b8-f814-499d-8843-9d8d58320d24 tempest-VolumesActionsTest-1194041985 None] Flow 'volume_create_manager' (4223a360-937c-4058-9c60-a18ad9daf82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:50:00 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8189f7b8-f814-499d-8843-9d8d58320d24 tempest-VolumesActionsTest-1194041985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fb23c47-68fd-44cf-9be0-cc3e45c1b175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:50:00 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8189f7b8-f814-499d-8843-9d8d58320d24 tempest-VolumesActionsTest-1194041985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fb23c47-68fd-44cf-9be0-cc3e45c1b175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:50:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-868205645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c88cc0b-6770-4aeb-97a9-5f99694b5dd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e59aaa1645df401a92217942d1b5382d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:50:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:50:00Z,use_quota=True,user_id='f672be7c1c8e466083ca7dcb1b1b35e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:50:00 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8189f7b8-f814-499d-8843-9d8d58320d24 tempest-VolumesActionsTest-1194041985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b50d192d-aeb1-4166-9c46-9e05c6a105ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:50:00 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8189f7b8-f814-499d-8843-9d8d58320d24 tempest-VolumesActionsTest-1194041985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b50d192d-aeb1-4166-9c46-9e05c6a105ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:50:00 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8189f7b8-f814-499d-8843-9d8d58320d24 tempest-VolumesActionsTest-1194041985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01483bf5-e8a7-46f3-a506-1c08a58060a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:50:00 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8189f7b8-f814-499d-8843-9d8d58320d24 tempest-VolumesActionsTest-1194041985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01483bf5-e8a7-46f3-a506-1c08a58060a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c88cc0b-6770-4aeb-97a9-5f99694b5dd7', 'volume_name': 'volume-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:50:00 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8189f7b8-f814-499d-8843-9d8d58320d24 tempest-VolumesActionsTest-1194041985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08f922ed-f888-4954-8bbe-0902db23d151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:50:00 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8189f7b8-f814-499d-8843-9d8d58320d24 tempest-VolumesActionsTest-1194041985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08f922ed-f888-4954-8bbe-0902db23d151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:50:00 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8189f7b8-f814-499d-8843-9d8d58320d24 tempest-VolumesActionsTest-1194041985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fe4df0a-4a71-4805-8dfe-f25774a86ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:50:00 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-8189f7b8-f814-499d-8843-9d8d58320d24 tempest-VolumesActionsTest-1194041985 None] Volume 9c88cc0b-6770-4aeb-97a9-5f99694b5dd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7', 'volume_size': 1} Apr 24 13:50:00 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-8189f7b8-f814-499d-8843-9d8d58320d24 tempest-VolumesActionsTest-1194041985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:50:00 devstack sudo[86775]: pam_unix(sudo:session): session closed for user root Apr 24 13:50:00 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-c02d8960-66dd-40bb-8304-431d18e59fa0 tempest-VolumesListTestJSON-944646595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d9a88624-e6d3-44e3-b511-82fca8139041 1073741824" returned: 0 in 1.074s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:50:00 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-c02d8960-66dd-40bb-8304-431d18e59fa0 tempest-VolumesListTestJSON-944646595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d9a88624-e6d3-44e3-b511-82fca8139041 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:50:00 devstack sudo[86795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d9a88624-e6d3-44e3-b511-82fca8139041 Apr 24 13:50:00 devstack sudo[86795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:50:01 devstack sudo[86795]: pam_unix(sudo:session): session closed for user root Apr 24 13:50:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-c02d8960-66dd-40bb-8304-431d18e59fa0 tempest-VolumesListTestJSON-944646595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d9a88624-e6d3-44e3-b511-82fca8139041" returned: 0 in 0.697s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:50:01 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-c02d8960-66dd-40bb-8304-431d18e59fa0 tempest-VolumesListTestJSON-944646595 None] <== create_volume: return (1829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:50:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-c02d8960-66dd-40bb-8304-431d18e59fa0 tempest-VolumesListTestJSON-944646595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.834s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:50:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-8189f7b8-f814-499d-8843-9d8d58320d24 tempest-VolumesActionsTest-1194041985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.199s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:50:01 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-8189f7b8-f814-499d-8843-9d8d58320d24 tempest-VolumesActionsTest-1194041985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:50:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-868205645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c88cc0b-6770-4aeb-97a9-5f99694b5dd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e59aaa1645df401a92217942d1b5382d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:50:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:50:00Z,use_quota=True,user_id='f672be7c1c8e466083ca7dcb1b1b35e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:50:01 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-8189f7b8-f814-499d-8843-9d8d58320d24 tempest-VolumesActionsTest-1194041985 None] Creating volume 9c88cc0b-6770-4aeb-97a9-5f99694b5dd7 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:50:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-8189f7b8-f814-499d-8843-9d8d58320d24 tempest-VolumesActionsTest-1194041985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:50:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-8189f7b8-f814-499d-8843-9d8d58320d24 tempest-VolumesActionsTest-1194041985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:50:01 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-8189f7b8-f814-499d-8843-9d8d58320d24 tempest-VolumesActionsTest-1194041985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:50:01 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-8189f7b8-f814-499d-8843-9d8d58320d24 tempest-VolumesActionsTest-1194041985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:50:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-8189f7b8-f814-499d-8843-9d8d58320d24 tempest-VolumesActionsTest-1194041985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:50:01 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-8189f7b8-f814-499d-8843-9d8d58320d24 tempest-VolumesActionsTest-1194041985 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:50:01 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-8189f7b8-f814-499d-8843-9d8d58320d24 tempest-VolumesActionsTest-1194041985 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:50:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8189f7b8-f814-499d-8843-9d8d58320d24 tempest-VolumesActionsTest-1194041985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:50:01 devstack sudo[86798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7 1073741824 Apr 24 13:50:01 devstack sudo[86798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:50:01 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c02d8960-66dd-40bb-8304-431d18e59fa0 tempest-VolumesListTestJSON-944646595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e72c729e-61c2-4bfb-8012-8b16fc61f8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9a88624-e6d3-44e3-b511-82fca8139041', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:50:01 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c02d8960-66dd-40bb-8304-431d18e59fa0 tempest-VolumesListTestJSON-944646595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e20b54a3-e2d8-40eb-92b6-b0bbd1281eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:50:01 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-c02d8960-66dd-40bb-8304-431d18e59fa0 tempest-VolumesListTestJSON-944646595 None] Volume volume-d9a88624-e6d3-44e3-b511-82fca8139041 (d9a88624-e6d3-44e3-b511-82fca8139041): created successfully Apr 24 13:50:01 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c02d8960-66dd-40bb-8304-431d18e59fa0 tempest-VolumesListTestJSON-944646595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e20b54a3-e2d8-40eb-92b6-b0bbd1281eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:50:01 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c02d8960-66dd-40bb-8304-431d18e59fa0 tempest-VolumesListTestJSON-944646595 None] Flow 'volume_create_manager' (6a34d961-c818-43a2-a964-7ddb3aad8a48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:50:01 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-c02d8960-66dd-40bb-8304-431d18e59fa0 tempest-VolumesListTestJSON-944646595 None] Created volume successfully. Apr 24 13:50:02 devstack sudo[86798]: pam_unix(sudo:session): session closed for user root Apr 24 13:50:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8189f7b8-f814-499d-8843-9d8d58320d24 tempest-VolumesActionsTest-1194041985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7 1073741824" returned: 0 in 0.845s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:50:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8189f7b8-f814-499d-8843-9d8d58320d24 tempest-VolumesActionsTest-1194041985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:50:02 devstack sudo[86803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7 Apr 24 13:50:02 devstack sudo[86803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:50:03 devstack sudo[86803]: pam_unix(sudo:session): session closed for user root Apr 24 13:50:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8189f7b8-f814-499d-8843-9d8d58320d24 tempest-VolumesActionsTest-1194041985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7" returned: 0 in 0.748s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:50:03 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-8189f7b8-f814-499d-8843-9d8d58320d24 tempest-VolumesActionsTest-1194041985 None] <== create_volume: return (1639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:50:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-8189f7b8-f814-499d-8843-9d8d58320d24 tempest-VolumesActionsTest-1194041985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.644s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:50:03 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8189f7b8-f814-499d-8843-9d8d58320d24 tempest-VolumesActionsTest-1194041985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fe4df0a-4a71-4805-8dfe-f25774a86ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:50:03 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8189f7b8-f814-499d-8843-9d8d58320d24 tempest-VolumesActionsTest-1194041985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07bd7716-7a60-4a36-b66e-e9057252aae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:50:03 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-8189f7b8-f814-499d-8843-9d8d58320d24 tempest-VolumesActionsTest-1194041985 None] Volume volume-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7 (9c88cc0b-6770-4aeb-97a9-5f99694b5dd7): created successfully Apr 24 13:50:03 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8189f7b8-f814-499d-8843-9d8d58320d24 tempest-VolumesActionsTest-1194041985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07bd7716-7a60-4a36-b66e-e9057252aae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:50:03 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8189f7b8-f814-499d-8843-9d8d58320d24 tempest-VolumesActionsTest-1194041985 None] Flow 'volume_create_manager' (4223a360-937c-4058-9c60-a18ad9daf82c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:50:03 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-8189f7b8-f814-499d-8843-9d8d58320d24 tempest-VolumesActionsTest-1194041985 None] Created volume successfully. Apr 24 13:50:04 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-64419fa7-43d2-49f4-8d32-f6fa1d4d8403 tempest-VolumesListTestJSON-944646595 None] Acquiring lock "cinder-d9a88624-e6d3-44e3-b511-82fca8139041-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:50:04 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-64419fa7-43d2-49f4-8d32-f6fa1d4d8403 tempest-VolumesListTestJSON-944646595 None] Lock "cinder-d9a88624-e6d3-44e3-b511-82fca8139041-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:50:04 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-64419fa7-43d2-49f4-8d32-f6fa1d4d8403 tempest-VolumesListTestJSON-944646595 None] Acquiring lock "cinder-quobyte-d9a88624-e6d3-44e3-b511-82fca8139041" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:50:04 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-64419fa7-43d2-49f4-8d32-f6fa1d4d8403 tempest-VolumesListTestJSON-944646595 None] Lock "cinder-quobyte-d9a88624-e6d3-44e3-b511-82fca8139041" acquired by "delete_volume" :: waited 0.020s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:50:04 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[6619c812-950f-4983-8b52-fd66cf05ae93]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:50:04 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-64419fa7-43d2-49f4-8d32-f6fa1d4d8403 tempest-VolumesListTestJSON-944646595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d9a88624-e6d3-44e3-b511-82fca8139041 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:50:04 devstack sudo[86808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d9a88624-e6d3-44e3-b511-82fca8139041 Apr 24 13:50:04 devstack sudo[86808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:50:05 devstack sudo[86808]: pam_unix(sudo:session): session closed for user root Apr 24 13:50:05 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-64419fa7-43d2-49f4-8d32-f6fa1d4d8403 tempest-VolumesListTestJSON-944646595 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d9a88624-e6d3-44e3-b511-82fca8139041" returned: 0 in 0.973s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:50:05 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-64419fa7-43d2-49f4-8d32-f6fa1d4d8403 tempest-VolumesListTestJSON-944646595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d9a88624-e6d3-44e3-b511-82fca8139041 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:50:05 devstack sudo[86818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d9a88624-e6d3-44e3-b511-82fca8139041 Apr 24 13:50:05 devstack sudo[86818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:50:06 devstack sudo[86818]: pam_unix(sudo:session): session closed for user root Apr 24 13:50:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-64419fa7-43d2-49f4-8d32-f6fa1d4d8403 tempest-VolumesListTestJSON-944646595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d9a88624-e6d3-44e3-b511-82fca8139041" returned: 0 in 0.709s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:50:06 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-64419fa7-43d2-49f4-8d32-f6fa1d4d8403 tempest-VolumesListTestJSON-944646595 None] Lock "cinder-quobyte-d9a88624-e6d3-44e3-b511-82fca8139041" released by "delete_volume" :: held 1.734s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:50:06 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-64419fa7-43d2-49f4-8d32-f6fa1d4d8403 tempest-VolumesListTestJSON-944646595 None] Created reservations ['cb4e00b3-f604-47ec-9eef-081f002993b3', '5004c7ab-6e1e-4831-a2d7-0e66119da8ae', '535d849b-2757-4bea-8c00-18ab8e7e1e55', 'a6b82316-af25-4fe1-9a25-5cb093f38ff6'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:50:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-64419fa7-43d2-49f4-8d32-f6fa1d4d8403 tempest-VolumesListTestJSON-944646595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:50:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-64419fa7-43d2-49f4-8d32-f6fa1d4d8403 tempest-VolumesListTestJSON-944646595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:50:06 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-64419fa7-43d2-49f4-8d32-f6fa1d4d8403 tempest-VolumesListTestJSON-944646595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:50:06 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-64419fa7-43d2-49f4-8d32-f6fa1d4d8403 tempest-VolumesListTestJSON-944646595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:50:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-64419fa7-43d2-49f4-8d32-f6fa1d4d8403 tempest-VolumesListTestJSON-944646595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:50:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-64419fa7-43d2-49f4-8d32-f6fa1d4d8403 tempest-VolumesListTestJSON-944646595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:50:06 devstack sudo[86825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:50:06 devstack sudo[86825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:50:07 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d1125ae9-0687-4960-866d-0cf859a017b0 tempest-VolumesListTestJSON-944646595 None] Acquiring lock "cinder-9bc5d65e-ac02-4aea-8772-ff17c8b9432a-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:50:07 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d1125ae9-0687-4960-866d-0cf859a017b0 tempest-VolumesListTestJSON-944646595 None] Lock "cinder-9bc5d65e-ac02-4aea-8772-ff17c8b9432a-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:50:07 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d1125ae9-0687-4960-866d-0cf859a017b0 tempest-VolumesListTestJSON-944646595 None] Acquiring lock "cinder-quobyte-9bc5d65e-ac02-4aea-8772-ff17c8b9432a" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:50:07 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d1125ae9-0687-4960-866d-0cf859a017b0 tempest-VolumesListTestJSON-944646595 None] Lock "cinder-quobyte-9bc5d65e-ac02-4aea-8772-ff17c8b9432a" acquired by "delete_volume" :: waited 0.022s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:50:07 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0ec497-12a0-4307-bf5a-e8530c42a827]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:50:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d1125ae9-0687-4960-866d-0cf859a017b0 tempest-VolumesListTestJSON-944646595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bc5d65e-ac02-4aea-8772-ff17c8b9432a {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:50:07 devstack sudo[86825]: pam_unix(sudo:session): session closed for user root Apr 24 13:50:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-64419fa7-43d2-49f4-8d32-f6fa1d4d8403 tempest-VolumesListTestJSON-944646595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.833s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:50:07 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-64419fa7-43d2-49f4-8d32-f6fa1d4d8403 tempest-VolumesListTestJSON-944646595 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:50:07 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-64419fa7-43d2-49f4-8d32-f6fa1d4d8403 tempest-VolumesListTestJSON-944646595 None] Deleted volume successfully. Apr 24 13:50:07 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-64419fa7-43d2-49f4-8d32-f6fa1d4d8403 tempest-VolumesListTestJSON-944646595 None] Lock "cinder-d9a88624-e6d3-44e3-b511-82fca8139041-delete_volume" released by "delete_volume" :: held 2.821s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:50:07 devstack sudo[86828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bc5d65e-ac02-4aea-8772-ff17c8b9432a Apr 24 13:50:07 devstack sudo[86828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:50:08 devstack sudo[86828]: pam_unix(sudo:session): session closed for user root Apr 24 13:50:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d1125ae9-0687-4960-866d-0cf859a017b0 tempest-VolumesListTestJSON-944646595 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bc5d65e-ac02-4aea-8772-ff17c8b9432a" returned: 0 in 0.858s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:50:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d1125ae9-0687-4960-866d-0cf859a017b0 tempest-VolumesListTestJSON-944646595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bc5d65e-ac02-4aea-8772-ff17c8b9432a {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:50:08 devstack sudo[86839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bc5d65e-ac02-4aea-8772-ff17c8b9432a Apr 24 13:50:08 devstack sudo[86839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:50:08 devstack sudo[86839]: pam_unix(sudo:session): session closed for user root Apr 24 13:50:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d1125ae9-0687-4960-866d-0cf859a017b0 tempest-VolumesListTestJSON-944646595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9bc5d65e-ac02-4aea-8772-ff17c8b9432a" returned: 0 in 0.698s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:50:08 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d1125ae9-0687-4960-866d-0cf859a017b0 tempest-VolumesListTestJSON-944646595 None] Lock "cinder-quobyte-9bc5d65e-ac02-4aea-8772-ff17c8b9432a" released by "delete_volume" :: held 1.618s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:50:08 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-d1125ae9-0687-4960-866d-0cf859a017b0 tempest-VolumesListTestJSON-944646595 None] Created reservations ['19b714d5-5950-46ae-aa9c-11ebf53411d1', 'afb2aca2-61b8-4110-972e-7d2f84bf7462', '140dd127-63ab-45e7-a985-9a54b9ce9f72', 'd5dd5688-3cdc-49ff-9a5d-fffd28e71a2a'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:50:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d1125ae9-0687-4960-866d-0cf859a017b0 tempest-VolumesListTestJSON-944646595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:50:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d1125ae9-0687-4960-866d-0cf859a017b0 tempest-VolumesListTestJSON-944646595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:50:09 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-d1125ae9-0687-4960-866d-0cf859a017b0 tempest-VolumesListTestJSON-944646595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:50:09 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-d1125ae9-0687-4960-866d-0cf859a017b0 tempest-VolumesListTestJSON-944646595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:50:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d1125ae9-0687-4960-866d-0cf859a017b0 tempest-VolumesListTestJSON-944646595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:50:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d1125ae9-0687-4960-866d-0cf859a017b0 tempest-VolumesListTestJSON-944646595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:50:09 devstack sudo[86850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:50:09 devstack sudo[86850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:50:09 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-f1fb4e80-0ffe-480b-addf-a44aeb0920bc tempest-VolumesListTestJSON-944646595 None] Acquiring lock "cinder-015693fb-0f32-4814-8ba9-64801b7b0761-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:50:09 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-f1fb4e80-0ffe-480b-addf-a44aeb0920bc tempest-VolumesListTestJSON-944646595 None] Lock "cinder-015693fb-0f32-4814-8ba9-64801b7b0761-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:50:09 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-f1fb4e80-0ffe-480b-addf-a44aeb0920bc tempest-VolumesListTestJSON-944646595 None] Acquiring lock "cinder-quobyte-015693fb-0f32-4814-8ba9-64801b7b0761" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:50:09 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-f1fb4e80-0ffe-480b-addf-a44aeb0920bc tempest-VolumesListTestJSON-944646595 None] Lock "cinder-quobyte-015693fb-0f32-4814-8ba9-64801b7b0761" acquired by "delete_volume" :: waited 0.039s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:50:09 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[753cdf41-91cb-4bc6-9234-a23b7783ef53]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:50:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f1fb4e80-0ffe-480b-addf-a44aeb0920bc tempest-VolumesListTestJSON-944646595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-015693fb-0f32-4814-8ba9-64801b7b0761 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:50:09 devstack sudo[86882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-015693fb-0f32-4814-8ba9-64801b7b0761 Apr 24 13:50:09 devstack sudo[86882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:50:10 devstack sudo[86850]: pam_unix(sudo:session): session closed for user root Apr 24 13:50:10 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d1125ae9-0687-4960-866d-0cf859a017b0 tempest-VolumesListTestJSON-944646595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 1.070s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:50:10 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-d1125ae9-0687-4960-866d-0cf859a017b0 tempest-VolumesListTestJSON-944646595 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:50:10 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-d1125ae9-0687-4960-866d-0cf859a017b0 tempest-VolumesListTestJSON-944646595 None] Deleted volume successfully. Apr 24 13:50:10 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d1125ae9-0687-4960-866d-0cf859a017b0 tempest-VolumesListTestJSON-944646595 None] Lock "cinder-9bc5d65e-ac02-4aea-8772-ff17c8b9432a-delete_volume" released by "delete_volume" :: held 3.056s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:50:10 devstack sudo[86882]: pam_unix(sudo:session): session closed for user root Apr 24 13:50:10 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f1fb4e80-0ffe-480b-addf-a44aeb0920bc tempest-VolumesListTestJSON-944646595 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-015693fb-0f32-4814-8ba9-64801b7b0761" returned: 0 in 1.199s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:50:10 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f1fb4e80-0ffe-480b-addf-a44aeb0920bc tempest-VolumesListTestJSON-944646595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-015693fb-0f32-4814-8ba9-64801b7b0761 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:50:11 devstack sudo[86887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-015693fb-0f32-4814-8ba9-64801b7b0761 Apr 24 13:50:11 devstack sudo[86887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:50:11 devstack sudo[86887]: pam_unix(sudo:session): session closed for user root Apr 24 13:50:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f1fb4e80-0ffe-480b-addf-a44aeb0920bc tempest-VolumesListTestJSON-944646595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-015693fb-0f32-4814-8ba9-64801b7b0761" returned: 0 in 0.769s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:50:11 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-f1fb4e80-0ffe-480b-addf-a44aeb0920bc tempest-VolumesListTestJSON-944646595 None] Lock "cinder-quobyte-015693fb-0f32-4814-8ba9-64801b7b0761" released by "delete_volume" :: held 2.040s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:50:11 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-f1fb4e80-0ffe-480b-addf-a44aeb0920bc tempest-VolumesListTestJSON-944646595 None] Created reservations ['db696e2a-388f-41a0-8971-f59765caa962', '88ce2b7a-c60e-48f9-82d4-38629f7366a5', 'ef701706-66c6-4418-b7bf-39a7ea036065', '29c7a39a-1a0c-447a-be36-14627043b01f'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:50:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f1fb4e80-0ffe-480b-addf-a44aeb0920bc tempest-VolumesListTestJSON-944646595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:50:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f1fb4e80-0ffe-480b-addf-a44aeb0920bc tempest-VolumesListTestJSON-944646595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:50:12 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-f1fb4e80-0ffe-480b-addf-a44aeb0920bc tempest-VolumesListTestJSON-944646595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:50:12 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-f1fb4e80-0ffe-480b-addf-a44aeb0920bc tempest-VolumesListTestJSON-944646595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:50:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f1fb4e80-0ffe-480b-addf-a44aeb0920bc tempest-VolumesListTestJSON-944646595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:50:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f1fb4e80-0ffe-480b-addf-a44aeb0920bc tempest-VolumesListTestJSON-944646595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:50:12 devstack sudo[86900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:50:12 devstack sudo[86900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:50:12 devstack sudo[86900]: pam_unix(sudo:session): session closed for user root Apr 24 13:50:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f1fb4e80-0ffe-480b-addf-a44aeb0920bc tempest-VolumesListTestJSON-944646595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.626s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:50:12 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-f1fb4e80-0ffe-480b-addf-a44aeb0920bc tempest-VolumesListTestJSON-944646595 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:50:12 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-f1fb4e80-0ffe-480b-addf-a44aeb0920bc tempest-VolumesListTestJSON-944646595 None] Deleted volume successfully. Apr 24 13:50:12 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-f1fb4e80-0ffe-480b-addf-a44aeb0920bc tempest-VolumesListTestJSON-944646595 None] Lock "cinder-015693fb-0f32-4814-8ba9-64801b7b0761-delete_volume" released by "delete_volume" :: held 3.113s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:50:17 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7df9d2e-afe7-4847-afbc-c0baa2ffef36 tempest-VolumesNegativeTest-570038845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:50:17 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c7df9d2e-afe7-4847-afbc-c0baa2ffef36 tempest-VolumesNegativeTest-570038845 None] Flow 'volume_create_manager' (d00f2d12-4cb8-4218-9dee-5beb96c83ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:50:17 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c7df9d2e-afe7-4847-afbc-c0baa2ffef36 tempest-VolumesNegativeTest-570038845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e1e8b85-4b37-43d1-ab5e-f47ecd9da337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:50:17 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c7df9d2e-afe7-4847-afbc-c0baa2ffef36 tempest-VolumesNegativeTest-570038845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e1e8b85-4b37-43d1-ab5e-f47ecd9da337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-420221442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4e0ee83-ee0e-4463-b7d6-bbdd8eb0ec1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='607c2cc9115147c193c0413400894e39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:50:17Z,use_quota=True,user_id='1d15968d3d5749a39d62ca355d227151',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:50:17 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c7df9d2e-afe7-4847-afbc-c0baa2ffef36 tempest-VolumesNegativeTest-570038845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1365f40c-0f7b-4c7e-922c-cf1f063f653f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:50:17 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c7df9d2e-afe7-4847-afbc-c0baa2ffef36 tempest-VolumesNegativeTest-570038845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1365f40c-0f7b-4c7e-922c-cf1f063f653f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:50:17 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c7df9d2e-afe7-4847-afbc-c0baa2ffef36 tempest-VolumesNegativeTest-570038845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4234b7fc-505d-4ed7-9fb1-2c362257a8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:50:17 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c7df9d2e-afe7-4847-afbc-c0baa2ffef36 tempest-VolumesNegativeTest-570038845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4234b7fc-505d-4ed7-9fb1-2c362257a8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4e0ee83-ee0e-4463-b7d6-bbdd8eb0ec1d', 'volume_name': 'volume-a4e0ee83-ee0e-4463-b7d6-bbdd8eb0ec1d', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:50:17 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c7df9d2e-afe7-4847-afbc-c0baa2ffef36 tempest-VolumesNegativeTest-570038845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20e888ab-8422-4810-b7e4-06a91a3f357c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:50:17 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c7df9d2e-afe7-4847-afbc-c0baa2ffef36 tempest-VolumesNegativeTest-570038845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20e888ab-8422-4810-b7e4-06a91a3f357c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:50:17 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c7df9d2e-afe7-4847-afbc-c0baa2ffef36 tempest-VolumesNegativeTest-570038845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (351ec4b9-b531-447a-8a83-83c4fcec710c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:50:17 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-c7df9d2e-afe7-4847-afbc-c0baa2ffef36 tempest-VolumesNegativeTest-570038845 None] Volume a4e0ee83-ee0e-4463-b7d6-bbdd8eb0ec1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4e0ee83-ee0e-4463-b7d6-bbdd8eb0ec1d', 'volume_size': 1} Apr 24 13:50:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-c7df9d2e-afe7-4847-afbc-c0baa2ffef36 tempest-VolumesNegativeTest-570038845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:50:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-c7df9d2e-afe7-4847-afbc-c0baa2ffef36 tempest-VolumesNegativeTest-570038845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:50:17 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-c7df9d2e-afe7-4847-afbc-c0baa2ffef36 tempest-VolumesNegativeTest-570038845 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-420221442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4e0ee83-ee0e-4463-b7d6-bbdd8eb0ec1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='607c2cc9115147c193c0413400894e39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:50:17Z,use_quota=True,user_id='1d15968d3d5749a39d62ca355d227151',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:50:17 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-c7df9d2e-afe7-4847-afbc-c0baa2ffef36 tempest-VolumesNegativeTest-570038845 None] Creating volume a4e0ee83-ee0e-4463-b7d6-bbdd8eb0ec1d {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:50:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-c7df9d2e-afe7-4847-afbc-c0baa2ffef36 tempest-VolumesNegativeTest-570038845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:50:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-c7df9d2e-afe7-4847-afbc-c0baa2ffef36 tempest-VolumesNegativeTest-570038845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:50:17 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-c7df9d2e-afe7-4847-afbc-c0baa2ffef36 tempest-VolumesNegativeTest-570038845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:50:17 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-c7df9d2e-afe7-4847-afbc-c0baa2ffef36 tempest-VolumesNegativeTest-570038845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:50:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-c7df9d2e-afe7-4847-afbc-c0baa2ffef36 tempest-VolumesNegativeTest-570038845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:50:17 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-c7df9d2e-afe7-4847-afbc-c0baa2ffef36 tempest-VolumesNegativeTest-570038845 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:50:17 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-c7df9d2e-afe7-4847-afbc-c0baa2ffef36 tempest-VolumesNegativeTest-570038845 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:50:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-c7df9d2e-afe7-4847-afbc-c0baa2ffef36 tempest-VolumesNegativeTest-570038845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a4e0ee83-ee0e-4463-b7d6-bbdd8eb0ec1d 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:50:17 devstack sudo[86950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a4e0ee83-ee0e-4463-b7d6-bbdd8eb0ec1d 1073741824 Apr 24 13:50:17 devstack sudo[86950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:50:19 devstack sudo[86950]: pam_unix(sudo:session): session closed for user root Apr 24 13:50:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-c7df9d2e-afe7-4847-afbc-c0baa2ffef36 tempest-VolumesNegativeTest-570038845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a4e0ee83-ee0e-4463-b7d6-bbdd8eb0ec1d 1073741824" returned: 0 in 1.529s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:50:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-c7df9d2e-afe7-4847-afbc-c0baa2ffef36 tempest-VolumesNegativeTest-570038845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a4e0ee83-ee0e-4463-b7d6-bbdd8eb0ec1d {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:50:19 devstack sudo[86955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a4e0ee83-ee0e-4463-b7d6-bbdd8eb0ec1d Apr 24 13:50:19 devstack sudo[86955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:50:19 devstack sudo[86955]: pam_unix(sudo:session): session closed for user root Apr 24 13:50:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-c7df9d2e-afe7-4847-afbc-c0baa2ffef36 tempest-VolumesNegativeTest-570038845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a4e0ee83-ee0e-4463-b7d6-bbdd8eb0ec1d" returned: 0 in 0.619s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:50:19 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-c7df9d2e-afe7-4847-afbc-c0baa2ffef36 tempest-VolumesNegativeTest-570038845 None] <== create_volume: return (2229ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:50:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-c7df9d2e-afe7-4847-afbc-c0baa2ffef36 tempest-VolumesNegativeTest-570038845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.232s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:50:19 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c7df9d2e-afe7-4847-afbc-c0baa2ffef36 tempest-VolumesNegativeTest-570038845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (351ec4b9-b531-447a-8a83-83c4fcec710c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4e0ee83-ee0e-4463-b7d6-bbdd8eb0ec1d', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:50:19 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c7df9d2e-afe7-4847-afbc-c0baa2ffef36 tempest-VolumesNegativeTest-570038845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1ab0edc-b052-4c8a-9f87-4176e1bd1b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:50:19 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-c7df9d2e-afe7-4847-afbc-c0baa2ffef36 tempest-VolumesNegativeTest-570038845 None] Volume volume-a4e0ee83-ee0e-4463-b7d6-bbdd8eb0ec1d (a4e0ee83-ee0e-4463-b7d6-bbdd8eb0ec1d): created successfully Apr 24 13:50:19 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c7df9d2e-afe7-4847-afbc-c0baa2ffef36 tempest-VolumesNegativeTest-570038845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1ab0edc-b052-4c8a-9f87-4176e1bd1b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:50:19 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c7df9d2e-afe7-4847-afbc-c0baa2ffef36 tempest-VolumesNegativeTest-570038845 None] Flow 'volume_create_manager' (d00f2d12-4cb8-4218-9dee-5beb96c83ef2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:50:20 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-c7df9d2e-afe7-4847-afbc-c0baa2ffef36 tempest-VolumesNegativeTest-570038845 None] Created volume successfully. Apr 24 13:50:21 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-13996907-53ac-41b4-9687-b6752521cf59 tempest-VolumesActionsTest-941549806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:50:21 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-13996907-53ac-41b4-9687-b6752521cf59 tempest-VolumesActionsTest-941549806 None] Flow 'volume_create_manager' (63b6106d-c3bb-42ba-b01c-a176c7b32f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:50:21 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-13996907-53ac-41b4-9687-b6752521cf59 tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5b59cd6-25ea-4e05-946e-bebd840e3a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:50:21 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-13996907-53ac-41b4-9687-b6752521cf59 tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5b59cd6-25ea-4e05-946e-bebd840e3a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-60409112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bde71efa-c2f6-4bea-8446-2c7181b30198,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fa054df8dd04aa49185baf39ad09316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:50:21Z,use_quota=True,user_id='ecc63534b53f4c1789a2195064ef0961',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:50:21 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-13996907-53ac-41b4-9687-b6752521cf59 tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f763437c-a70c-49ac-a743-9d82d3862494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:50:21 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-13996907-53ac-41b4-9687-b6752521cf59 tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f763437c-a70c-49ac-a743-9d82d3862494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:50:21 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-13996907-53ac-41b4-9687-b6752521cf59 tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49a5221e-fb3d-495f-a3fe-f29e0db5d6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:50:21 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-13996907-53ac-41b4-9687-b6752521cf59 tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49a5221e-fb3d-495f-a3fe-f29e0db5d6a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bde71efa-c2f6-4bea-8446-2c7181b30198', 'volume_name': 'volume-bde71efa-c2f6-4bea-8446-2c7181b30198', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:50:21 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-13996907-53ac-41b4-9687-b6752521cf59 tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03e4abbd-9ce8-404e-a030-9efd1a356b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:50:21 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-13996907-53ac-41b4-9687-b6752521cf59 tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03e4abbd-9ce8-404e-a030-9efd1a356b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:50:21 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-13996907-53ac-41b4-9687-b6752521cf59 tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16077472-e873-422e-aed1-941ec49c1bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:50:21 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-13996907-53ac-41b4-9687-b6752521cf59 tempest-VolumesActionsTest-941549806 None] Volume bde71efa-c2f6-4bea-8446-2c7181b30198: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bde71efa-c2f6-4bea-8446-2c7181b30198', 'volume_size': 1} Apr 24 13:50:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-13996907-53ac-41b4-9687-b6752521cf59 tempest-VolumesActionsTest-941549806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:50:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-13996907-53ac-41b4-9687-b6752521cf59 tempest-VolumesActionsTest-941549806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:50:21 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-13996907-53ac-41b4-9687-b6752521cf59 tempest-VolumesActionsTest-941549806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-60409112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bde71efa-c2f6-4bea-8446-2c7181b30198,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fa054df8dd04aa49185baf39ad09316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:50:21Z,use_quota=True,user_id='ecc63534b53f4c1789a2195064ef0961',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:50:21 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-13996907-53ac-41b4-9687-b6752521cf59 tempest-VolumesActionsTest-941549806 None] Creating volume bde71efa-c2f6-4bea-8446-2c7181b30198 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:50:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-13996907-53ac-41b4-9687-b6752521cf59 tempest-VolumesActionsTest-941549806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:50:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-13996907-53ac-41b4-9687-b6752521cf59 tempest-VolumesActionsTest-941549806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:50:21 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-13996907-53ac-41b4-9687-b6752521cf59 tempest-VolumesActionsTest-941549806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:50:21 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-13996907-53ac-41b4-9687-b6752521cf59 tempest-VolumesActionsTest-941549806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:50:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-13996907-53ac-41b4-9687-b6752521cf59 tempest-VolumesActionsTest-941549806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:50:21 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-13996907-53ac-41b4-9687-b6752521cf59 tempest-VolumesActionsTest-941549806 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:50:21 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-13996907-53ac-41b4-9687-b6752521cf59 tempest-VolumesActionsTest-941549806 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:50:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-13996907-53ac-41b4-9687-b6752521cf59 tempest-VolumesActionsTest-941549806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bde71efa-c2f6-4bea-8446-2c7181b30198 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:50:21 devstack sudo[86966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bde71efa-c2f6-4bea-8446-2c7181b30198 1073741824 Apr 24 13:50:21 devstack sudo[86966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:50:23 devstack sudo[86966]: pam_unix(sudo:session): session closed for user root Apr 24 13:50:23 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-13996907-53ac-41b4-9687-b6752521cf59 tempest-VolumesActionsTest-941549806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bde71efa-c2f6-4bea-8446-2c7181b30198 1073741824" returned: 0 in 1.725s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:50:23 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-13996907-53ac-41b4-9687-b6752521cf59 tempest-VolumesActionsTest-941549806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bde71efa-c2f6-4bea-8446-2c7181b30198 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:50:23 devstack sudo[86991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bde71efa-c2f6-4bea-8446-2c7181b30198 Apr 24 13:50:23 devstack sudo[86991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:50:24 devstack sudo[86991]: pam_unix(sudo:session): session closed for user root Apr 24 13:50:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-13996907-53ac-41b4-9687-b6752521cf59 tempest-VolumesActionsTest-941549806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bde71efa-c2f6-4bea-8446-2c7181b30198" returned: 0 in 1.317s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:50:24 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-13996907-53ac-41b4-9687-b6752521cf59 tempest-VolumesActionsTest-941549806 None] <== create_volume: return (3137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:50:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-13996907-53ac-41b4-9687-b6752521cf59 tempest-VolumesActionsTest-941549806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.143s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:50:24 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-13996907-53ac-41b4-9687-b6752521cf59 tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16077472-e873-422e-aed1-941ec49c1bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bde71efa-c2f6-4bea-8446-2c7181b30198', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:50:24 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-13996907-53ac-41b4-9687-b6752521cf59 tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1661b900-cae0-4228-8600-812a659da529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:50:24 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-13996907-53ac-41b4-9687-b6752521cf59 tempest-VolumesActionsTest-941549806 None] Volume volume-bde71efa-c2f6-4bea-8446-2c7181b30198 (bde71efa-c2f6-4bea-8446-2c7181b30198): created successfully Apr 24 13:50:24 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-13996907-53ac-41b4-9687-b6752521cf59 tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1661b900-cae0-4228-8600-812a659da529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:50:24 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-13996907-53ac-41b4-9687-b6752521cf59 tempest-VolumesActionsTest-941549806 None] Flow 'volume_create_manager' (63b6106d-c3bb-42ba-b01c-a176c7b32f6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:50:24 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-13996907-53ac-41b4-9687-b6752521cf59 tempest-VolumesActionsTest-941549806 None] Created volume successfully. Apr 24 13:50:25 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d2fd733f-32a2-4d3d-a662-b19381ca01e0 tempest-VolumesActionsTest-941549806 None] Acquiring lock "cinder-bde71efa-c2f6-4bea-8446-2c7181b30198" by "attach_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:50:25 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d2fd733f-32a2-4d3d-a662-b19381ca01e0 tempest-VolumesActionsTest-941549806 None] Lock "cinder-bde71efa-c2f6-4bea-8446-2c7181b30198" acquired by "attach_volume" :: waited 0.094s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:50:25 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-d2fd733f-32a2-4d3d-a662-b19381ca01e0 tempest-VolumesActionsTest-941549806 None] Attaching volume bde71efa-c2f6-4bea-8446-2c7181b30198 to instance 0dc8fee6-6590-49b9-8ddd-ea2e6504693d at mountpoint /dev/vdb on host None. Apr 24 13:50:25 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-d2fd733f-32a2-4d3d-a662-b19381ca01e0 tempest-VolumesActionsTest-941549806 None] Attach volume completed successfully. Apr 24 13:50:25 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d2fd733f-32a2-4d3d-a662-b19381ca01e0 tempest-VolumesActionsTest-941549806 None] Lock "cinder-bde71efa-c2f6-4bea-8446-2c7181b30198" released by "attach_volume" :: held 0.261s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:50:27 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-a6813036-af71-435f-9030-bbe58c2604b7 tempest-VolumesActionsTest-1607067325 None] Terminate volume connection completed successfully. Apr 24 13:50:28 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-a6813036-af71-435f-9030-bbe58c2604b7 tempest-VolumesActionsTest-1607067325 None] Acquiring lock "cinder-bde71efa-c2f6-4bea-8446-2c7181b30198-detach_volume" by "detach_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:50:28 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-a6813036-af71-435f-9030-bbe58c2604b7 tempest-VolumesActionsTest-1607067325 None] Lock "cinder-bde71efa-c2f6-4bea-8446-2c7181b30198-detach_volume" acquired by "detach_volume" :: waited 0.042s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:50:28 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-a6813036-af71-435f-9030-bbe58c2604b7 tempest-VolumesActionsTest-1607067325 None] Detaching volume bde71efa-c2f6-4bea-8446-2c7181b30198 from instance 0dc8fee6-6590-49b9-8ddd-ea2e6504693d. Apr 24 13:50:28 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-a6813036-af71-435f-9030-bbe58c2604b7 tempest-VolumesActionsTest-1607067325 None] Detach volume completed successfully. Apr 24 13:50:28 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-a6813036-af71-435f-9030-bbe58c2604b7 tempest-VolumesActionsTest-1607067325 None] Lock "cinder-bde71efa-c2f6-4bea-8446-2c7181b30198-detach_volume" released by "detach_volume" :: held 0.220s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:50:28 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-db246214-bfcc-4bc4-bd3a-2f6e0f470db2 tempest-VolumesActionsTest-1194041985 None] Acquiring lock "cinder-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7" by "attach_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:50:29 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-db246214-bfcc-4bc4-bd3a-2f6e0f470db2 tempest-VolumesActionsTest-1194041985 None] Lock "cinder-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7" acquired by "attach_volume" :: waited 0.037s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:50:29 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-fe6fce5e-a290-414b-98cc-254ce6ea2f2d tempest-VolumesActionsTest-941549806 None] Acquiring lock "cinder-bde71efa-c2f6-4bea-8446-2c7181b30198-detach_volume" by "detach_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:50:29 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-fe6fce5e-a290-414b-98cc-254ce6ea2f2d tempest-VolumesActionsTest-941549806 None] Lock "cinder-bde71efa-c2f6-4bea-8446-2c7181b30198-detach_volume" acquired by "detach_volume" :: waited 0.151s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:50:29 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-fe6fce5e-a290-414b-98cc-254ce6ea2f2d tempest-VolumesActionsTest-941549806 None] Volume detach called, but volume not attached. Apr 24 13:50:29 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-db246214-bfcc-4bc4-bd3a-2f6e0f470db2 tempest-VolumesActionsTest-1194041985 None] Attaching volume 9c88cc0b-6770-4aeb-97a9-5f99694b5dd7 to instance 940e49a4-212c-4fd5-b091-809dee9a49c0 at mountpoint /dev/vdb on host None. Apr 24 13:50:29 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-fe6fce5e-a290-414b-98cc-254ce6ea2f2d tempest-VolumesActionsTest-941549806 None] Lock "cinder-bde71efa-c2f6-4bea-8446-2c7181b30198-detach_volume" released by "detach_volume" :: held 0.078s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:50:29 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-db246214-bfcc-4bc4-bd3a-2f6e0f470db2 tempest-VolumesActionsTest-1194041985 None] Attach volume completed successfully. Apr 24 13:50:29 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-db246214-bfcc-4bc4-bd3a-2f6e0f470db2 tempest-VolumesActionsTest-1194041985 None] Lock "cinder-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7" released by "attach_volume" :: held 0.461s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:50:29 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-990120bd-53d4-437c-8c6b-18309b969f66 tempest-VolumesActionsTest-1194041985 None] Acquiring lock "cinder-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7-detach_volume" by "detach_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:50:29 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-990120bd-53d4-437c-8c6b-18309b969f66 tempest-VolumesActionsTest-1194041985 None] Lock "cinder-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:50:29 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-990120bd-53d4-437c-8c6b-18309b969f66 tempest-VolumesActionsTest-1194041985 None] Detaching volume 9c88cc0b-6770-4aeb-97a9-5f99694b5dd7 from instance 940e49a4-212c-4fd5-b091-809dee9a49c0. Apr 24 13:50:29 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-990120bd-53d4-437c-8c6b-18309b969f66 tempest-VolumesActionsTest-1194041985 None] Detach volume completed successfully. Apr 24 13:50:29 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-990120bd-53d4-437c-8c6b-18309b969f66 tempest-VolumesActionsTest-1194041985 None] Lock "cinder-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7-detach_volume" released by "detach_volume" :: held 0.197s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:50:30 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-8b037322-535e-496f-8797-8a61679cd0a9 tempest-VolumesActionsTest-941549806 None] Acquiring lock "cinder-bde71efa-c2f6-4bea-8446-2c7181b30198-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:50:30 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-8b037322-535e-496f-8797-8a61679cd0a9 tempest-VolumesActionsTest-941549806 None] Lock "cinder-bde71efa-c2f6-4bea-8446-2c7181b30198-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:50:30 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-8b037322-535e-496f-8797-8a61679cd0a9 tempest-VolumesActionsTest-941549806 None] Acquiring lock "cinder-quobyte-bde71efa-c2f6-4bea-8446-2c7181b30198" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:50:30 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-8b037322-535e-496f-8797-8a61679cd0a9 tempest-VolumesActionsTest-941549806 None] Lock "cinder-quobyte-bde71efa-c2f6-4bea-8446-2c7181b30198" acquired by "delete_volume" :: waited 0.041s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:50:30 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[43af1ca1-3829-404f-94ce-5e651f8cb972]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:50:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8b037322-535e-496f-8797-8a61679cd0a9 tempest-VolumesActionsTest-941549806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bde71efa-c2f6-4bea-8446-2c7181b30198 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:50:30 devstack sudo[87069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bde71efa-c2f6-4bea-8446-2c7181b30198 Apr 24 13:50:30 devstack sudo[87069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:50:31 devstack sudo[87069]: pam_unix(sudo:session): session closed for user root Apr 24 13:50:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8b037322-535e-496f-8797-8a61679cd0a9 tempest-VolumesActionsTest-941549806 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bde71efa-c2f6-4bea-8446-2c7181b30198" returned: 0 in 1.581s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:50:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8b037322-535e-496f-8797-8a61679cd0a9 tempest-VolumesActionsTest-941549806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bde71efa-c2f6-4bea-8446-2c7181b30198 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:50:31 devstack sudo[87100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bde71efa-c2f6-4bea-8446-2c7181b30198 Apr 24 13:50:31 devstack sudo[87100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:50:32 devstack sudo[87100]: pam_unix(sudo:session): session closed for user root Apr 24 13:50:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8b037322-535e-496f-8797-8a61679cd0a9 tempest-VolumesActionsTest-941549806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bde71efa-c2f6-4bea-8446-2c7181b30198" returned: 0 in 0.851s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:50:32 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-8b037322-535e-496f-8797-8a61679cd0a9 tempest-VolumesActionsTest-941549806 None] Lock "cinder-quobyte-bde71efa-c2f6-4bea-8446-2c7181b30198" released by "delete_volume" :: held 2.567s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:50:32 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-8b037322-535e-496f-8797-8a61679cd0a9 tempest-VolumesActionsTest-941549806 None] Created reservations ['d6613cc2-fc22-4cd5-9881-68ee0bc8de81', 'b6d393d5-efee-4114-8222-3fca4e96de6b', 'e8de0d9e-11e3-4bb4-978d-206e90954772', '7fdd43e4-68ef-46f4-8e89-34466f031ed8'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:50:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-8b037322-535e-496f-8797-8a61679cd0a9 tempest-VolumesActionsTest-941549806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:50:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-8b037322-535e-496f-8797-8a61679cd0a9 tempest-VolumesActionsTest-941549806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:50:32 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-8b037322-535e-496f-8797-8a61679cd0a9 tempest-VolumesActionsTest-941549806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:50:33 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-8b037322-535e-496f-8797-8a61679cd0a9 tempest-VolumesActionsTest-941549806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:50:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-8b037322-535e-496f-8797-8a61679cd0a9 tempest-VolumesActionsTest-941549806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:50:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8b037322-535e-496f-8797-8a61679cd0a9 tempest-VolumesActionsTest-941549806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:50:33 devstack sudo[87132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:50:33 devstack sudo[87132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:50:33 devstack sudo[87132]: pam_unix(sudo:session): session closed for user root Apr 24 13:50:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8b037322-535e-496f-8797-8a61679cd0a9 tempest-VolumesActionsTest-941549806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.671s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:50:33 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-8b037322-535e-496f-8797-8a61679cd0a9 tempest-VolumesActionsTest-941549806 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:50:33 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-8b037322-535e-496f-8797-8a61679cd0a9 tempest-VolumesActionsTest-941549806 None] Deleted volume successfully. Apr 24 13:50:33 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-8b037322-535e-496f-8797-8a61679cd0a9 tempest-VolumesActionsTest-941549806 None] Lock "cinder-bde71efa-c2f6-4bea-8446-2c7181b30198-delete_volume" released by "delete_volume" :: held 3.674s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:50:37 devstack cinder-volume[82046]: DEBUG oslo_service.periodic_task [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82046) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 13:50:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:50:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:50:37 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:50:37 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:50:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:50:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:50:37 devstack sudo[87197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:50:37 devstack sudo[87197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:50:38 devstack sudo[87197]: pam_unix(sudo:session): session closed for user root Apr 24 13:50:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.706s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:50:38 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:50:42 devstack cinder-volume[82046]: DEBUG dbcounter [-] [82046] Writing DB stats cinder:SELECT=46,cinder:UPDATE=63,cinder:DELETE=6,cinder:INSERT=12 {{(pid=82046) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 13:50:43 devstack cinder-volume[82046]: DEBUG dbcounter [-] [82046] Writing DB stats cinder:SELECT=60,cinder:UPDATE=71,cinder:INSERT=19,cinder:DELETE=6 {{(pid=82046) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 13:50:43 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-4850107e-12dd-4ad1-917e-21aa474ab950 tempest-VolumesActionsTest-941549806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:50:43 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4850107e-12dd-4ad1-917e-21aa474ab950 tempest-VolumesActionsTest-941549806 None] Flow 'volume_create_manager' (71786164-6705-4ac0-95f2-3885ae8fdb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:50:43 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4850107e-12dd-4ad1-917e-21aa474ab950 tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f2b1dc3-c3af-432a-82e2-cb7cf7aea87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:50:43 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4850107e-12dd-4ad1-917e-21aa474ab950 tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f2b1dc3-c3af-432a-82e2-cb7cf7aea87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:50:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-11126322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b21eed88-bd38-498b-920c-754f0ff366da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fa054df8dd04aa49185baf39ad09316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:50:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:50:43Z,use_quota=True,user_id='ecc63534b53f4c1789a2195064ef0961',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:50:43 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4850107e-12dd-4ad1-917e-21aa474ab950 tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e113860-6ccb-45ed-9f3d-68879b59fe45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:50:43 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4850107e-12dd-4ad1-917e-21aa474ab950 tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e113860-6ccb-45ed-9f3d-68879b59fe45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:50:43 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4850107e-12dd-4ad1-917e-21aa474ab950 tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (870ce391-3179-4afd-8a80-3291b54677f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:50:43 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4850107e-12dd-4ad1-917e-21aa474ab950 tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (870ce391-3179-4afd-8a80-3291b54677f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b21eed88-bd38-498b-920c-754f0ff366da', 'volume_name': 'volume-b21eed88-bd38-498b-920c-754f0ff366da', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:50:43 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4850107e-12dd-4ad1-917e-21aa474ab950 tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3bced4e-0d0c-49ab-ad0e-fd06355c90b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:50:43 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4850107e-12dd-4ad1-917e-21aa474ab950 tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3bced4e-0d0c-49ab-ad0e-fd06355c90b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:50:43 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4850107e-12dd-4ad1-917e-21aa474ab950 tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1795a4ff-10cc-47b5-8f4b-5f9ba1d07cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:50:43 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-4850107e-12dd-4ad1-917e-21aa474ab950 tempest-VolumesActionsTest-941549806 None] Volume b21eed88-bd38-498b-920c-754f0ff366da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b21eed88-bd38-498b-920c-754f0ff366da', 'volume_size': 1} Apr 24 13:50:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4850107e-12dd-4ad1-917e-21aa474ab950 tempest-VolumesActionsTest-941549806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:50:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4850107e-12dd-4ad1-917e-21aa474ab950 tempest-VolumesActionsTest-941549806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:50:43 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-4850107e-12dd-4ad1-917e-21aa474ab950 tempest-VolumesActionsTest-941549806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:50:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-11126322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b21eed88-bd38-498b-920c-754f0ff366da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fa054df8dd04aa49185baf39ad09316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:50:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:50:43Z,use_quota=True,user_id='ecc63534b53f4c1789a2195064ef0961',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:50:43 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-4850107e-12dd-4ad1-917e-21aa474ab950 tempest-VolumesActionsTest-941549806 None] Creating volume b21eed88-bd38-498b-920c-754f0ff366da {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:50:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4850107e-12dd-4ad1-917e-21aa474ab950 tempest-VolumesActionsTest-941549806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:50:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4850107e-12dd-4ad1-917e-21aa474ab950 tempest-VolumesActionsTest-941549806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:50:43 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-4850107e-12dd-4ad1-917e-21aa474ab950 tempest-VolumesActionsTest-941549806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:50:43 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-4850107e-12dd-4ad1-917e-21aa474ab950 tempest-VolumesActionsTest-941549806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:50:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4850107e-12dd-4ad1-917e-21aa474ab950 tempest-VolumesActionsTest-941549806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:50:43 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-4850107e-12dd-4ad1-917e-21aa474ab950 tempest-VolumesActionsTest-941549806 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:50:43 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-4850107e-12dd-4ad1-917e-21aa474ab950 tempest-VolumesActionsTest-941549806 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:50:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4850107e-12dd-4ad1-917e-21aa474ab950 tempest-VolumesActionsTest-941549806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b21eed88-bd38-498b-920c-754f0ff366da 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:50:43 devstack sudo[87313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b21eed88-bd38-498b-920c-754f0ff366da 1073741824 Apr 24 13:50:43 devstack sudo[87313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:50:44 devstack sudo[87313]: pam_unix(sudo:session): session closed for user root Apr 24 13:50:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4850107e-12dd-4ad1-917e-21aa474ab950 tempest-VolumesActionsTest-941549806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b21eed88-bd38-498b-920c-754f0ff366da 1073741824" returned: 0 in 1.057s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:50:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4850107e-12dd-4ad1-917e-21aa474ab950 tempest-VolumesActionsTest-941549806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b21eed88-bd38-498b-920c-754f0ff366da {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:50:44 devstack sudo[87365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b21eed88-bd38-498b-920c-754f0ff366da Apr 24 13:50:44 devstack sudo[87365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:50:46 devstack sudo[87365]: pam_unix(sudo:session): session closed for user root Apr 24 13:50:46 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4850107e-12dd-4ad1-917e-21aa474ab950 tempest-VolumesActionsTest-941549806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b21eed88-bd38-498b-920c-754f0ff366da" returned: 0 in 2.112s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:50:46 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-4850107e-12dd-4ad1-917e-21aa474ab950 tempest-VolumesActionsTest-941549806 None] <== create_volume: return (3291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:50:46 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4850107e-12dd-4ad1-917e-21aa474ab950 tempest-VolumesActionsTest-941549806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.294s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:50:46 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4850107e-12dd-4ad1-917e-21aa474ab950 tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1795a4ff-10cc-47b5-8f4b-5f9ba1d07cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b21eed88-bd38-498b-920c-754f0ff366da', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:50:47 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4850107e-12dd-4ad1-917e-21aa474ab950 tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa173927-dc11-4a97-abab-9238acfe096e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:50:47 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-4850107e-12dd-4ad1-917e-21aa474ab950 tempest-VolumesActionsTest-941549806 None] Volume volume-b21eed88-bd38-498b-920c-754f0ff366da (b21eed88-bd38-498b-920c-754f0ff366da): created successfully Apr 24 13:50:47 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4850107e-12dd-4ad1-917e-21aa474ab950 tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa173927-dc11-4a97-abab-9238acfe096e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:50:47 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4850107e-12dd-4ad1-917e-21aa474ab950 tempest-VolumesActionsTest-941549806 None] Flow 'volume_create_manager' (71786164-6705-4ac0-95f2-3885ae8fdb5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:50:47 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-4850107e-12dd-4ad1-917e-21aa474ab950 tempest-VolumesActionsTest-941549806 None] Created volume successfully. Apr 24 13:50:48 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-2209a7d5-48c5-41c3-a581-46ba3f01682e tempest-VolumesActionsTest-1607067325 None] Acquiring lock "cinder-b21eed88-bd38-498b-920c-754f0ff366da-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:50:48 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-2209a7d5-48c5-41c3-a581-46ba3f01682e tempest-VolumesActionsTest-1607067325 None] Lock "cinder-b21eed88-bd38-498b-920c-754f0ff366da-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:50:49 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-2209a7d5-48c5-41c3-a581-46ba3f01682e tempest-VolumesActionsTest-1607067325 None] Acquiring lock "cinder-quobyte-b21eed88-bd38-498b-920c-754f0ff366da" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:50:49 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-2209a7d5-48c5-41c3-a581-46ba3f01682e tempest-VolumesActionsTest-1607067325 None] Lock "cinder-quobyte-b21eed88-bd38-498b-920c-754f0ff366da" acquired by "delete_volume" :: waited 0.063s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:50:49 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1cf344-64d5-44d4-9c14-a3c02d16ad82]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:50:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2209a7d5-48c5-41c3-a581-46ba3f01682e tempest-VolumesActionsTest-1607067325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b21eed88-bd38-498b-920c-754f0ff366da {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:50:49 devstack sudo[87403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b21eed88-bd38-498b-920c-754f0ff366da Apr 24 13:50:49 devstack sudo[87403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:50:51 devstack sudo[87403]: pam_unix(sudo:session): session closed for user root Apr 24 13:50:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2209a7d5-48c5-41c3-a581-46ba3f01682e tempest-VolumesActionsTest-1607067325 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b21eed88-bd38-498b-920c-754f0ff366da" returned: 0 in 2.164s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:50:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2209a7d5-48c5-41c3-a581-46ba3f01682e tempest-VolumesActionsTest-1607067325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b21eed88-bd38-498b-920c-754f0ff366da {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:50:51 devstack sudo[87416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b21eed88-bd38-498b-920c-754f0ff366da Apr 24 13:50:51 devstack sudo[87416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:50:53 devstack sudo[87416]: pam_unix(sudo:session): session closed for user root Apr 24 13:50:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2209a7d5-48c5-41c3-a581-46ba3f01682e tempest-VolumesActionsTest-1607067325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b21eed88-bd38-498b-920c-754f0ff366da" returned: 0 in 2.592s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:50:54 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-2209a7d5-48c5-41c3-a581-46ba3f01682e tempest-VolumesActionsTest-1607067325 None] Lock "cinder-quobyte-b21eed88-bd38-498b-920c-754f0ff366da" released by "delete_volume" :: held 4.981s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:50:54 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-2209a7d5-48c5-41c3-a581-46ba3f01682e tempest-VolumesActionsTest-1607067325 None] Created reservations ['a0f6658d-b7d3-46a9-9a51-11570baf4658', '02c4a734-c61e-4832-8ff7-9e8f024673d5', 'eb37c569-12e3-4051-8844-a9543950eb73', 'fa31f434-0b41-48a5-b53c-c589fcc9b272'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:50:54 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-2209a7d5-48c5-41c3-a581-46ba3f01682e tempest-VolumesActionsTest-1607067325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:50:54 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-2209a7d5-48c5-41c3-a581-46ba3f01682e tempest-VolumesActionsTest-1607067325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:50:54 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-2209a7d5-48c5-41c3-a581-46ba3f01682e tempest-VolumesActionsTest-1607067325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:50:54 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-2209a7d5-48c5-41c3-a581-46ba3f01682e tempest-VolumesActionsTest-1607067325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:50:54 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-2209a7d5-48c5-41c3-a581-46ba3f01682e tempest-VolumesActionsTest-1607067325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:50:54 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2209a7d5-48c5-41c3-a581-46ba3f01682e tempest-VolumesActionsTest-1607067325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:50:54 devstack sudo[87446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:50:54 devstack sudo[87446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:50:56 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-f79a47dc-17ed-4920-9442-846f9191f8ae tempest-VolumesActionsTest-941549806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:50:56 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f79a47dc-17ed-4920-9442-846f9191f8ae tempest-VolumesActionsTest-941549806 None] Flow 'volume_create_manager' (2dca99be-b34d-4b50-a51e-4fc01949938c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:50:56 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f79a47dc-17ed-4920-9442-846f9191f8ae tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2c71c1a-a10f-410e-8093-ecfeb45d8809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:50:56 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f79a47dc-17ed-4920-9442-846f9191f8ae tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2c71c1a-a10f-410e-8093-ecfeb45d8809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:50:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-196772048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=968c7bee-d02a-46de-9f83-7e89945627bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fa054df8dd04aa49185baf39ad09316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:50:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:50:57Z,use_quota=True,user_id='ecc63534b53f4c1789a2195064ef0961',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:50:56 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f79a47dc-17ed-4920-9442-846f9191f8ae tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25315ed6-df53-4f1a-a8d4-b7d3297dc65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:50:56 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f79a47dc-17ed-4920-9442-846f9191f8ae tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25315ed6-df53-4f1a-a8d4-b7d3297dc65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:50:56 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f79a47dc-17ed-4920-9442-846f9191f8ae tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (533d95a2-9098-4767-8a59-15eb3cd4850b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:50:56 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f79a47dc-17ed-4920-9442-846f9191f8ae tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (533d95a2-9098-4767-8a59-15eb3cd4850b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '968c7bee-d02a-46de-9f83-7e89945627bb', 'volume_name': 'volume-968c7bee-d02a-46de-9f83-7e89945627bb', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:50:56 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f79a47dc-17ed-4920-9442-846f9191f8ae tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (948583cb-b256-45f7-b382-c46047049c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:50:56 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f79a47dc-17ed-4920-9442-846f9191f8ae tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (948583cb-b256-45f7-b382-c46047049c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:50:56 devstack sudo[87446]: pam_unix(sudo:session): session closed for user root Apr 24 13:50:56 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f79a47dc-17ed-4920-9442-846f9191f8ae tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd9650a1-a239-4b70-80ca-8ead483abc3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:50:56 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-f79a47dc-17ed-4920-9442-846f9191f8ae tempest-VolumesActionsTest-941549806 None] Volume 968c7bee-d02a-46de-9f83-7e89945627bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-968c7bee-d02a-46de-9f83-7e89945627bb', 'volume_size': 1} Apr 24 13:50:56 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f79a47dc-17ed-4920-9442-846f9191f8ae tempest-VolumesActionsTest-941549806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:50:56 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f79a47dc-17ed-4920-9442-846f9191f8ae tempest-VolumesActionsTest-941549806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:50:56 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-f79a47dc-17ed-4920-9442-846f9191f8ae tempest-VolumesActionsTest-941549806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:50:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-196772048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=968c7bee-d02a-46de-9f83-7e89945627bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fa054df8dd04aa49185baf39ad09316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:50:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:50:57Z,use_quota=True,user_id='ecc63534b53f4c1789a2195064ef0961',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:50:56 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-f79a47dc-17ed-4920-9442-846f9191f8ae tempest-VolumesActionsTest-941549806 None] Creating volume 968c7bee-d02a-46de-9f83-7e89945627bb {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:50:56 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f79a47dc-17ed-4920-9442-846f9191f8ae tempest-VolumesActionsTest-941549806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:50:57 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f79a47dc-17ed-4920-9442-846f9191f8ae tempest-VolumesActionsTest-941549806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:50:57 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-f79a47dc-17ed-4920-9442-846f9191f8ae tempest-VolumesActionsTest-941549806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:50:57 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-f79a47dc-17ed-4920-9442-846f9191f8ae tempest-VolumesActionsTest-941549806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:50:57 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f79a47dc-17ed-4920-9442-846f9191f8ae tempest-VolumesActionsTest-941549806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.065s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:50:57 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-f79a47dc-17ed-4920-9442-846f9191f8ae tempest-VolumesActionsTest-941549806 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:50:57 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-f79a47dc-17ed-4920-9442-846f9191f8ae tempest-VolumesActionsTest-941549806 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:50:57 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f79a47dc-17ed-4920-9442-846f9191f8ae tempest-VolumesActionsTest-941549806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-968c7bee-d02a-46de-9f83-7e89945627bb 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:50:57 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2209a7d5-48c5-41c3-a581-46ba3f01682e tempest-VolumesActionsTest-1607067325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 2.538s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:50:57 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-2209a7d5-48c5-41c3-a581-46ba3f01682e tempest-VolumesActionsTest-1607067325 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:50:57 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-2209a7d5-48c5-41c3-a581-46ba3f01682e tempest-VolumesActionsTest-1607067325 None] Deleted volume successfully. Apr 24 13:50:57 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-2209a7d5-48c5-41c3-a581-46ba3f01682e tempest-VolumesActionsTest-1607067325 None] Lock "cinder-b21eed88-bd38-498b-920c-754f0ff366da-delete_volume" released by "delete_volume" :: held 8.243s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:50:57 devstack sudo[87458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-968c7bee-d02a-46de-9f83-7e89945627bb 1073741824 Apr 24 13:50:57 devstack sudo[87458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:50:58 devstack sudo[87458]: pam_unix(sudo:session): session closed for user root Apr 24 13:50:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f79a47dc-17ed-4920-9442-846f9191f8ae tempest-VolumesActionsTest-941549806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-968c7bee-d02a-46de-9f83-7e89945627bb 1073741824" returned: 0 in 1.291s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:50:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f79a47dc-17ed-4920-9442-846f9191f8ae tempest-VolumesActionsTest-941549806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-968c7bee-d02a-46de-9f83-7e89945627bb {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:50:58 devstack sudo[87495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-968c7bee-d02a-46de-9f83-7e89945627bb Apr 24 13:50:58 devstack sudo[87495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:50:59 devstack sudo[87495]: pam_unix(sudo:session): session closed for user root Apr 24 13:50:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f79a47dc-17ed-4920-9442-846f9191f8ae tempest-VolumesActionsTest-941549806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-968c7bee-d02a-46de-9f83-7e89945627bb" returned: 0 in 0.871s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:50:59 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-f79a47dc-17ed-4920-9442-846f9191f8ae tempest-VolumesActionsTest-941549806 None] <== create_volume: return (2268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:50:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f79a47dc-17ed-4920-9442-846f9191f8ae tempest-VolumesActionsTest-941549806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.273s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:50:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f79a47dc-17ed-4920-9442-846f9191f8ae tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd9650a1-a239-4b70-80ca-8ead483abc3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-968c7bee-d02a-46de-9f83-7e89945627bb', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:50:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f79a47dc-17ed-4920-9442-846f9191f8ae tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3054d058-8036-4cd1-bc97-d1420b30c2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:50:59 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-f79a47dc-17ed-4920-9442-846f9191f8ae tempest-VolumesActionsTest-941549806 None] Volume volume-968c7bee-d02a-46de-9f83-7e89945627bb (968c7bee-d02a-46de-9f83-7e89945627bb): created successfully Apr 24 13:50:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f79a47dc-17ed-4920-9442-846f9191f8ae tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3054d058-8036-4cd1-bc97-d1420b30c2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:50:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f79a47dc-17ed-4920-9442-846f9191f8ae tempest-VolumesActionsTest-941549806 None] Flow 'volume_create_manager' (2dca99be-b34d-4b50-a51e-4fc01949938c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:50:59 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-f79a47dc-17ed-4920-9442-846f9191f8ae tempest-VolumesActionsTest-941549806 None] Created volume successfully. Apr 24 13:51:00 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-4fe9e087-466f-4a4e-9287-5eefceb405fd tempest-VolumesActionsTest-1607067325 None] Acquiring lock "cinder-968c7bee-d02a-46de-9f83-7e89945627bb-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:51:00 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-4fe9e087-466f-4a4e-9287-5eefceb405fd tempest-VolumesActionsTest-1607067325 None] Lock "cinder-968c7bee-d02a-46de-9f83-7e89945627bb-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:51:00 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-4fe9e087-466f-4a4e-9287-5eefceb405fd tempest-VolumesActionsTest-1607067325 None] Acquiring lock "cinder-quobyte-968c7bee-d02a-46de-9f83-7e89945627bb" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:51:00 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-4fe9e087-466f-4a4e-9287-5eefceb405fd tempest-VolumesActionsTest-1607067325 None] Lock "cinder-quobyte-968c7bee-d02a-46de-9f83-7e89945627bb" acquired by "delete_volume" :: waited 0.021s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:51:00 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf426f0-b61a-45cd-85d8-789914986072]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:51:00 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4fe9e087-466f-4a4e-9287-5eefceb405fd tempest-VolumesActionsTest-1607067325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-968c7bee-d02a-46de-9f83-7e89945627bb {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:51:00 devstack sudo[87539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-968c7bee-d02a-46de-9f83-7e89945627bb Apr 24 13:51:00 devstack sudo[87539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:51:01 devstack sudo[87539]: pam_unix(sudo:session): session closed for user root Apr 24 13:51:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4fe9e087-466f-4a4e-9287-5eefceb405fd tempest-VolumesActionsTest-1607067325 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-968c7bee-d02a-46de-9f83-7e89945627bb" returned: 0 in 0.685s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:51:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4fe9e087-466f-4a4e-9287-5eefceb405fd tempest-VolumesActionsTest-1607067325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-968c7bee-d02a-46de-9f83-7e89945627bb {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:51:01 devstack sudo[87552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-968c7bee-d02a-46de-9f83-7e89945627bb Apr 24 13:51:01 devstack sudo[87552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:51:01 devstack sudo[87552]: pam_unix(sudo:session): session closed for user root Apr 24 13:51:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4fe9e087-466f-4a4e-9287-5eefceb405fd tempest-VolumesActionsTest-1607067325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-968c7bee-d02a-46de-9f83-7e89945627bb" returned: 0 in 0.768s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:51:01 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-4fe9e087-466f-4a4e-9287-5eefceb405fd tempest-VolumesActionsTest-1607067325 None] Lock "cinder-quobyte-968c7bee-d02a-46de-9f83-7e89945627bb" released by "delete_volume" :: held 1.543s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:51:01 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-4fe9e087-466f-4a4e-9287-5eefceb405fd tempest-VolumesActionsTest-1607067325 None] Created reservations ['d285c2d1-8a57-45e2-bd11-5e793622413c', '482bc3ee-d0bb-435b-84bc-ad8eb856e89f', '57f38757-f2f4-48fd-9de8-bad4555d179a', '27ab49e4-4c0f-457a-9ab1-8d8b748b3b1a'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:51:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4fe9e087-466f-4a4e-9287-5eefceb405fd tempest-VolumesActionsTest-1607067325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:51:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4fe9e087-466f-4a4e-9287-5eefceb405fd tempest-VolumesActionsTest-1607067325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:51:02 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-4fe9e087-466f-4a4e-9287-5eefceb405fd tempest-VolumesActionsTest-1607067325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:51:02 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-4fe9e087-466f-4a4e-9287-5eefceb405fd tempest-VolumesActionsTest-1607067325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:51:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4fe9e087-466f-4a4e-9287-5eefceb405fd tempest-VolumesActionsTest-1607067325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:51:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4fe9e087-466f-4a4e-9287-5eefceb405fd tempest-VolumesActionsTest-1607067325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:51:02 devstack sudo[87596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:51:02 devstack sudo[87596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:51:02 devstack sudo[87596]: pam_unix(sudo:session): session closed for user root Apr 24 13:51:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4fe9e087-466f-4a4e-9287-5eefceb405fd tempest-VolumesActionsTest-1607067325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.906s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:51:03 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-4fe9e087-466f-4a4e-9287-5eefceb405fd tempest-VolumesActionsTest-1607067325 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:51:03 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-4fe9e087-466f-4a4e-9287-5eefceb405fd tempest-VolumesActionsTest-1607067325 None] Deleted volume successfully. Apr 24 13:51:03 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-4fe9e087-466f-4a4e-9287-5eefceb405fd tempest-VolumesActionsTest-1607067325 None] Lock "cinder-968c7bee-d02a-46de-9f83-7e89945627bb-delete_volume" released by "delete_volume" :: held 2.844s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:51:03 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-1da49563-3df6-4a8d-abe5-1ffdf44f57ea tempest-VolumesActionsTest-941549806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:51:03 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-1da49563-3df6-4a8d-abe5-1ffdf44f57ea tempest-VolumesActionsTest-941549806 None] Flow 'volume_create_manager' (843894a9-b223-418c-93a5-3464ccd4c792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:51:03 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-1da49563-3df6-4a8d-abe5-1ffdf44f57ea tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2935ffac-a1a9-4069-81b1-ad4f551ca2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:51:03 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-1da49563-3df6-4a8d-abe5-1ffdf44f57ea tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2935ffac-a1a9-4069-81b1-ad4f551ca2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1808013047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d10c47fb-9992-4cab-b8b7-ebd11e00466f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fa054df8dd04aa49185baf39ad09316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:51:04Z,use_quota=True,user_id='ecc63534b53f4c1789a2195064ef0961',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:51:03 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-1da49563-3df6-4a8d-abe5-1ffdf44f57ea tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20226a72-b93d-47ff-9f6f-24eae9761080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:51:03 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-1da49563-3df6-4a8d-abe5-1ffdf44f57ea tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20226a72-b93d-47ff-9f6f-24eae9761080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:51:03 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-1da49563-3df6-4a8d-abe5-1ffdf44f57ea tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e8c4c7e-1909-4526-a2ed-5244c04cf83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:51:03 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-1da49563-3df6-4a8d-abe5-1ffdf44f57ea tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e8c4c7e-1909-4526-a2ed-5244c04cf83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd10c47fb-9992-4cab-b8b7-ebd11e00466f', 'volume_name': 'volume-d10c47fb-9992-4cab-b8b7-ebd11e00466f', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:51:03 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-1da49563-3df6-4a8d-abe5-1ffdf44f57ea tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a16ac98c-5581-4952-9ddd-05e700a53fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:51:03 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-1da49563-3df6-4a8d-abe5-1ffdf44f57ea tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a16ac98c-5581-4952-9ddd-05e700a53fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:51:03 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-1da49563-3df6-4a8d-abe5-1ffdf44f57ea tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac5f04b3-ee45-4e96-938c-8c084bbf1d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:51:03 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-1da49563-3df6-4a8d-abe5-1ffdf44f57ea tempest-VolumesActionsTest-941549806 None] Volume d10c47fb-9992-4cab-b8b7-ebd11e00466f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d10c47fb-9992-4cab-b8b7-ebd11e00466f', 'volume_size': 1} Apr 24 13:51:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-1da49563-3df6-4a8d-abe5-1ffdf44f57ea tempest-VolumesActionsTest-941549806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:51:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-1da49563-3df6-4a8d-abe5-1ffdf44f57ea tempest-VolumesActionsTest-941549806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:51:03 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-1da49563-3df6-4a8d-abe5-1ffdf44f57ea tempest-VolumesActionsTest-941549806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1808013047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d10c47fb-9992-4cab-b8b7-ebd11e00466f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fa054df8dd04aa49185baf39ad09316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:51:04Z,use_quota=True,user_id='ecc63534b53f4c1789a2195064ef0961',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:51:03 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-1da49563-3df6-4a8d-abe5-1ffdf44f57ea tempest-VolumesActionsTest-941549806 None] Creating volume d10c47fb-9992-4cab-b8b7-ebd11e00466f {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:51:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-1da49563-3df6-4a8d-abe5-1ffdf44f57ea tempest-VolumesActionsTest-941549806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:51:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-1da49563-3df6-4a8d-abe5-1ffdf44f57ea tempest-VolumesActionsTest-941549806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:51:03 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-1da49563-3df6-4a8d-abe5-1ffdf44f57ea tempest-VolumesActionsTest-941549806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:51:03 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-1da49563-3df6-4a8d-abe5-1ffdf44f57ea tempest-VolumesActionsTest-941549806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:51:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-1da49563-3df6-4a8d-abe5-1ffdf44f57ea tempest-VolumesActionsTest-941549806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:51:03 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-1da49563-3df6-4a8d-abe5-1ffdf44f57ea tempest-VolumesActionsTest-941549806 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:51:03 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-1da49563-3df6-4a8d-abe5-1ffdf44f57ea tempest-VolumesActionsTest-941549806 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:51:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-1da49563-3df6-4a8d-abe5-1ffdf44f57ea tempest-VolumesActionsTest-941549806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d10c47fb-9992-4cab-b8b7-ebd11e00466f 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:51:03 devstack sudo[87612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d10c47fb-9992-4cab-b8b7-ebd11e00466f 1073741824 Apr 24 13:51:03 devstack sudo[87612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:51:05 devstack sudo[87612]: pam_unix(sudo:session): session closed for user root Apr 24 13:51:05 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-1da49563-3df6-4a8d-abe5-1ffdf44f57ea tempest-VolumesActionsTest-941549806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d10c47fb-9992-4cab-b8b7-ebd11e00466f 1073741824" returned: 0 in 1.787s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:51:05 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-1da49563-3df6-4a8d-abe5-1ffdf44f57ea tempest-VolumesActionsTest-941549806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d10c47fb-9992-4cab-b8b7-ebd11e00466f {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:51:05 devstack sudo[87653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d10c47fb-9992-4cab-b8b7-ebd11e00466f Apr 24 13:51:05 devstack sudo[87653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:51:05 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-fa43222a-a45a-4d52-bb93-d2184ffde511 tempest-VolumesActionsTest-1194041985 None] Acquiring lock "cinder-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7" by "attach_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:51:05 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-fa43222a-a45a-4d52-bb93-d2184ffde511 tempest-VolumesActionsTest-1194041985 None] Lock "cinder-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7" acquired by "attach_volume" :: waited 0.031s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:51:06 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-fa43222a-a45a-4d52-bb93-d2184ffde511 tempest-VolumesActionsTest-1194041985 None] Attaching volume 9c88cc0b-6770-4aeb-97a9-5f99694b5dd7 to instance 39729626-e891-48ae-b1f1-1dff32b7e415 at mountpoint /dev/vdb on host None. Apr 24 13:51:06 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-fa43222a-a45a-4d52-bb93-d2184ffde511 tempest-VolumesActionsTest-1194041985 None] Attach volume completed successfully. Apr 24 13:51:06 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-fa43222a-a45a-4d52-bb93-d2184ffde511 tempest-VolumesActionsTest-1194041985 None] Lock "cinder-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7" released by "attach_volume" :: held 0.217s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:51:06 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-7dd11be5-dc55-4482-b348-a8c328aac785 tempest-VolumesActionsTest-1194041985 None] Acquiring lock "cinder-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7-detach_volume" by "detach_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:51:06 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-7dd11be5-dc55-4482-b348-a8c328aac785 tempest-VolumesActionsTest-1194041985 None] Lock "cinder-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:51:06 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-7dd11be5-dc55-4482-b348-a8c328aac785 tempest-VolumesActionsTest-1194041985 None] Detaching volume 9c88cc0b-6770-4aeb-97a9-5f99694b5dd7 from instance 39729626-e891-48ae-b1f1-1dff32b7e415. Apr 24 13:51:06 devstack sudo[87653]: pam_unix(sudo:session): session closed for user root Apr 24 13:51:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-1da49563-3df6-4a8d-abe5-1ffdf44f57ea tempest-VolumesActionsTest-941549806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d10c47fb-9992-4cab-b8b7-ebd11e00466f" returned: 0 in 1.263s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:51:06 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-1da49563-3df6-4a8d-abe5-1ffdf44f57ea tempest-VolumesActionsTest-941549806 None] <== create_volume: return (3162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:51:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-1da49563-3df6-4a8d-abe5-1ffdf44f57ea tempest-VolumesActionsTest-941549806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.168s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:51:07 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-1da49563-3df6-4a8d-abe5-1ffdf44f57ea tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac5f04b3-ee45-4e96-938c-8c084bbf1d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d10c47fb-9992-4cab-b8b7-ebd11e00466f', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:51:07 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-1da49563-3df6-4a8d-abe5-1ffdf44f57ea tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4104598c-b426-48ec-9cd8-5ac9a48460ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:51:07 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-1da49563-3df6-4a8d-abe5-1ffdf44f57ea tempest-VolumesActionsTest-941549806 None] Volume volume-d10c47fb-9992-4cab-b8b7-ebd11e00466f (d10c47fb-9992-4cab-b8b7-ebd11e00466f): created successfully Apr 24 13:51:07 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-1da49563-3df6-4a8d-abe5-1ffdf44f57ea tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4104598c-b426-48ec-9cd8-5ac9a48460ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:51:07 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-1da49563-3df6-4a8d-abe5-1ffdf44f57ea tempest-VolumesActionsTest-941549806 None] Flow 'volume_create_manager' (843894a9-b223-418c-93a5-3464ccd4c792) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:51:07 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-1da49563-3df6-4a8d-abe5-1ffdf44f57ea tempest-VolumesActionsTest-941549806 None] Created volume successfully. Apr 24 13:51:07 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-7dd11be5-dc55-4482-b348-a8c328aac785 tempest-VolumesActionsTest-1194041985 None] Detach volume completed successfully. Apr 24 13:51:07 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-7dd11be5-dc55-4482-b348-a8c328aac785 tempest-VolumesActionsTest-1194041985 None] Lock "cinder-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7-detach_volume" released by "detach_volume" :: held 0.252s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:51:08 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf9230ef-43ed-4445-84db-cb840d71d9c4 tempest-ServerRescueNegativeTestJSON-75264286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:51:08 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-cf9230ef-43ed-4445-84db-cb840d71d9c4 tempest-ServerRescueNegativeTestJSON-75264286 None] Flow 'volume_create_manager' (a4103c50-1375-4d29-9684-b02eff2d4fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:51:08 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-cf9230ef-43ed-4445-84db-cb840d71d9c4 tempest-ServerRescueNegativeTestJSON-75264286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6f22943-1ffa-4b69-bb09-84b2cf6b57ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:51:08 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-cf9230ef-43ed-4445-84db-cb840d71d9c4 tempest-ServerRescueNegativeTestJSON-75264286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6f22943-1ffa-4b69-bb09-84b2cf6b57ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-816374978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23849847-92bf-47ff-913e-f0d795e7598b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fc65f1f1e304725ad15339df87d70c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:51:08Z,use_quota=True,user_id='d156132d33e14346b610736352d8827c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:51:08 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-cf9230ef-43ed-4445-84db-cb840d71d9c4 tempest-ServerRescueNegativeTestJSON-75264286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99807700-4f3d-41bf-9792-01248a7fe5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:51:08 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-cf9230ef-43ed-4445-84db-cb840d71d9c4 tempest-ServerRescueNegativeTestJSON-75264286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99807700-4f3d-41bf-9792-01248a7fe5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:51:08 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-cf9230ef-43ed-4445-84db-cb840d71d9c4 tempest-ServerRescueNegativeTestJSON-75264286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3654efcd-79e5-4280-ad39-32136eb237fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:51:08 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-cf9230ef-43ed-4445-84db-cb840d71d9c4 tempest-ServerRescueNegativeTestJSON-75264286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3654efcd-79e5-4280-ad39-32136eb237fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23849847-92bf-47ff-913e-f0d795e7598b', 'volume_name': 'volume-23849847-92bf-47ff-913e-f0d795e7598b', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:51:08 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-cf9230ef-43ed-4445-84db-cb840d71d9c4 tempest-ServerRescueNegativeTestJSON-75264286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c28c3ea0-ecfe-4a84-989e-3c6e98796edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:51:08 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-cf9230ef-43ed-4445-84db-cb840d71d9c4 tempest-ServerRescueNegativeTestJSON-75264286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c28c3ea0-ecfe-4a84-989e-3c6e98796edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:51:08 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-cf9230ef-43ed-4445-84db-cb840d71d9c4 tempest-ServerRescueNegativeTestJSON-75264286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (def931d0-f8c1-4800-8349-6d43b54b6a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:51:08 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-cf9230ef-43ed-4445-84db-cb840d71d9c4 tempest-ServerRescueNegativeTestJSON-75264286 None] Volume 23849847-92bf-47ff-913e-f0d795e7598b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23849847-92bf-47ff-913e-f0d795e7598b', 'volume_size': 1} Apr 24 13:51:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-cf9230ef-43ed-4445-84db-cb840d71d9c4 tempest-ServerRescueNegativeTestJSON-75264286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:51:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-cf9230ef-43ed-4445-84db-cb840d71d9c4 tempest-ServerRescueNegativeTestJSON-75264286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:51:08 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-cf9230ef-43ed-4445-84db-cb840d71d9c4 tempest-ServerRescueNegativeTestJSON-75264286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-816374978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23849847-92bf-47ff-913e-f0d795e7598b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fc65f1f1e304725ad15339df87d70c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:51:08Z,use_quota=True,user_id='d156132d33e14346b610736352d8827c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:51:08 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-cf9230ef-43ed-4445-84db-cb840d71d9c4 tempest-ServerRescueNegativeTestJSON-75264286 None] Creating volume 23849847-92bf-47ff-913e-f0d795e7598b {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:51:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-cf9230ef-43ed-4445-84db-cb840d71d9c4 tempest-ServerRescueNegativeTestJSON-75264286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:51:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-cf9230ef-43ed-4445-84db-cb840d71d9c4 tempest-ServerRescueNegativeTestJSON-75264286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:51:08 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-cf9230ef-43ed-4445-84db-cb840d71d9c4 tempest-ServerRescueNegativeTestJSON-75264286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:51:08 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-cf9230ef-43ed-4445-84db-cb840d71d9c4 tempest-ServerRescueNegativeTestJSON-75264286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:51:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-cf9230ef-43ed-4445-84db-cb840d71d9c4 tempest-ServerRescueNegativeTestJSON-75264286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:51:08 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-cf9230ef-43ed-4445-84db-cb840d71d9c4 tempest-ServerRescueNegativeTestJSON-75264286 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:51:08 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-cf9230ef-43ed-4445-84db-cb840d71d9c4 tempest-ServerRescueNegativeTestJSON-75264286 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:51:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-cf9230ef-43ed-4445-84db-cb840d71d9c4 tempest-ServerRescueNegativeTestJSON-75264286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-23849847-92bf-47ff-913e-f0d795e7598b 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:51:08 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-7182c73c-451e-4ce1-ac7f-bb03f4b9b145 tempest-VolumesActionsTest-1607067325 None] Acquiring lock "cinder-d10c47fb-9992-4cab-b8b7-ebd11e00466f-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:51:08 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-7182c73c-451e-4ce1-ac7f-bb03f4b9b145 tempest-VolumesActionsTest-1607067325 None] Lock "cinder-d10c47fb-9992-4cab-b8b7-ebd11e00466f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:51:08 devstack sudo[87658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-23849847-92bf-47ff-913e-f0d795e7598b 1073741824 Apr 24 13:51:08 devstack sudo[87658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:51:09 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-7182c73c-451e-4ce1-ac7f-bb03f4b9b145 tempest-VolumesActionsTest-1607067325 None] Acquiring lock "cinder-quobyte-d10c47fb-9992-4cab-b8b7-ebd11e00466f" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:51:09 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-7182c73c-451e-4ce1-ac7f-bb03f4b9b145 tempest-VolumesActionsTest-1607067325 None] Lock "cinder-quobyte-d10c47fb-9992-4cab-b8b7-ebd11e00466f" acquired by "delete_volume" :: waited 0.041s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:51:09 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[972b8539-21b9-41d8-89b3-d4e5427af4cb]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:51:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7182c73c-451e-4ce1-ac7f-bb03f4b9b145 tempest-VolumesActionsTest-1607067325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d10c47fb-9992-4cab-b8b7-ebd11e00466f {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:51:09 devstack sudo[87669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d10c47fb-9992-4cab-b8b7-ebd11e00466f Apr 24 13:51:09 devstack sudo[87669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:51:10 devstack sudo[87658]: pam_unix(sudo:session): session closed for user root Apr 24 13:51:10 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-cf9230ef-43ed-4445-84db-cb840d71d9c4 tempest-ServerRescueNegativeTestJSON-75264286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-23849847-92bf-47ff-913e-f0d795e7598b 1073741824" returned: 0 in 1.624s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:51:10 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-cf9230ef-43ed-4445-84db-cb840d71d9c4 tempest-ServerRescueNegativeTestJSON-75264286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-23849847-92bf-47ff-913e-f0d795e7598b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:51:10 devstack sudo[87669]: pam_unix(sudo:session): session closed for user root Apr 24 13:51:10 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7182c73c-451e-4ce1-ac7f-bb03f4b9b145 tempest-VolumesActionsTest-1607067325 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d10c47fb-9992-4cab-b8b7-ebd11e00466f" returned: 0 in 1.406s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:51:10 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7182c73c-451e-4ce1-ac7f-bb03f4b9b145 tempest-VolumesActionsTest-1607067325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d10c47fb-9992-4cab-b8b7-ebd11e00466f {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:51:10 devstack sudo[87694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-23849847-92bf-47ff-913e-f0d795e7598b Apr 24 13:51:10 devstack sudo[87694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:51:10 devstack sudo[87695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d10c47fb-9992-4cab-b8b7-ebd11e00466f Apr 24 13:51:10 devstack sudo[87695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:51:11 devstack sudo[87695]: pam_unix(sudo:session): session closed for user root Apr 24 13:51:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7182c73c-451e-4ce1-ac7f-bb03f4b9b145 tempest-VolumesActionsTest-1607067325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d10c47fb-9992-4cab-b8b7-ebd11e00466f" returned: 0 in 0.777s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:51:11 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-7182c73c-451e-4ce1-ac7f-bb03f4b9b145 tempest-VolumesActionsTest-1607067325 None] Lock "cinder-quobyte-d10c47fb-9992-4cab-b8b7-ebd11e00466f" released by "delete_volume" :: held 2.295s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:51:11 devstack sudo[87694]: pam_unix(sudo:session): session closed for user root Apr 24 13:51:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-cf9230ef-43ed-4445-84db-cb840d71d9c4 tempest-ServerRescueNegativeTestJSON-75264286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-23849847-92bf-47ff-913e-f0d795e7598b" returned: 0 in 0.858s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:51:11 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-cf9230ef-43ed-4445-84db-cb840d71d9c4 tempest-ServerRescueNegativeTestJSON-75264286 None] <== create_volume: return (2580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:51:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-cf9230ef-43ed-4445-84db-cb840d71d9c4 tempest-ServerRescueNegativeTestJSON-75264286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.588s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:51:11 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-cf9230ef-43ed-4445-84db-cb840d71d9c4 tempest-ServerRescueNegativeTestJSON-75264286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (def931d0-f8c1-4800-8349-6d43b54b6a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23849847-92bf-47ff-913e-f0d795e7598b', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:51:11 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-cf9230ef-43ed-4445-84db-cb840d71d9c4 tempest-ServerRescueNegativeTestJSON-75264286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (265121f8-26bf-49c6-ae0e-aca08ecdfde8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:51:11 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-cf9230ef-43ed-4445-84db-cb840d71d9c4 tempest-ServerRescueNegativeTestJSON-75264286 None] Volume volume-23849847-92bf-47ff-913e-f0d795e7598b (23849847-92bf-47ff-913e-f0d795e7598b): created successfully Apr 24 13:51:11 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-cf9230ef-43ed-4445-84db-cb840d71d9c4 tempest-ServerRescueNegativeTestJSON-75264286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (265121f8-26bf-49c6-ae0e-aca08ecdfde8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:51:11 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-cf9230ef-43ed-4445-84db-cb840d71d9c4 tempest-ServerRescueNegativeTestJSON-75264286 None] Flow 'volume_create_manager' (a4103c50-1375-4d29-9684-b02eff2d4fec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:51:11 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-cf9230ef-43ed-4445-84db-cb840d71d9c4 tempest-ServerRescueNegativeTestJSON-75264286 None] Created volume successfully. Apr 24 13:51:11 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-7182c73c-451e-4ce1-ac7f-bb03f4b9b145 tempest-VolumesActionsTest-1607067325 None] Created reservations ['59bdff44-55cd-4dd2-be8c-058eccd48128', '7b738f98-5adf-4bf9-a1f9-ac5a82c327c8', 'f98e791b-aed8-4224-b67d-c9085c25d24a', '1c3423a2-5c5e-4f9e-bb15-436224386be3'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:51:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-7182c73c-451e-4ce1-ac7f-bb03f4b9b145 tempest-VolumesActionsTest-1607067325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:51:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-7182c73c-451e-4ce1-ac7f-bb03f4b9b145 tempest-VolumesActionsTest-1607067325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:51:11 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-7182c73c-451e-4ce1-ac7f-bb03f4b9b145 tempest-VolumesActionsTest-1607067325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:51:11 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-7182c73c-451e-4ce1-ac7f-bb03f4b9b145 tempest-VolumesActionsTest-1607067325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:51:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-7182c73c-451e-4ce1-ac7f-bb03f4b9b145 tempest-VolumesActionsTest-1607067325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:51:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7182c73c-451e-4ce1-ac7f-bb03f4b9b145 tempest-VolumesActionsTest-1607067325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:51:11 devstack sudo[87702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:51:11 devstack sudo[87702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:51:12 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-35132b6c-0a32-4f07-ac39-2839c5af2040 tempest-VolumesNegativeTest-570038845 None] Acquiring lock "cinder-a4e0ee83-ee0e-4463-b7d6-bbdd8eb0ec1d-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:51:12 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-35132b6c-0a32-4f07-ac39-2839c5af2040 tempest-VolumesNegativeTest-570038845 None] Lock "cinder-a4e0ee83-ee0e-4463-b7d6-bbdd8eb0ec1d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:51:13 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-35132b6c-0a32-4f07-ac39-2839c5af2040 tempest-VolumesNegativeTest-570038845 None] Acquiring lock "cinder-quobyte-a4e0ee83-ee0e-4463-b7d6-bbdd8eb0ec1d" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:51:13 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-35132b6c-0a32-4f07-ac39-2839c5af2040 tempest-VolumesNegativeTest-570038845 None] Lock "cinder-quobyte-a4e0ee83-ee0e-4463-b7d6-bbdd8eb0ec1d" acquired by "delete_volume" :: waited 0.022s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:51:13 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[191e666c-5cfe-4257-9845-d2fa9c42a3b1]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:51:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-35132b6c-0a32-4f07-ac39-2839c5af2040 tempest-VolumesNegativeTest-570038845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a4e0ee83-ee0e-4463-b7d6-bbdd8eb0ec1d {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:51:13 devstack sudo[87702]: pam_unix(sudo:session): session closed for user root Apr 24 13:51:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7182c73c-451e-4ce1-ac7f-bb03f4b9b145 tempest-VolumesActionsTest-1607067325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 1.276s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:51:13 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-7182c73c-451e-4ce1-ac7f-bb03f4b9b145 tempest-VolumesActionsTest-1607067325 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:51:13 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-7182c73c-451e-4ce1-ac7f-bb03f4b9b145 tempest-VolumesActionsTest-1607067325 None] Deleted volume successfully. Apr 24 13:51:13 devstack sudo[87706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a4e0ee83-ee0e-4463-b7d6-bbdd8eb0ec1d Apr 24 13:51:13 devstack sudo[87706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:51:13 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-7182c73c-451e-4ce1-ac7f-bb03f4b9b145 tempest-VolumesActionsTest-1607067325 None] Lock "cinder-d10c47fb-9992-4cab-b8b7-ebd11e00466f-delete_volume" released by "delete_volume" :: held 4.302s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:51:13 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5a3007b-d231-4c4e-aa6a-78899ba7fa45 tempest-VolumesActionsTest-941549806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:51:13 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b5a3007b-d231-4c4e-aa6a-78899ba7fa45 tempest-VolumesActionsTest-941549806 None] Flow 'volume_create_manager' (c508a0fe-1149-4d33-baca-525786af28bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:51:13 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b5a3007b-d231-4c4e-aa6a-78899ba7fa45 tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bd6cb3c-ded7-4aa4-804a-ce3927d0d806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:51:13 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b5a3007b-d231-4c4e-aa6a-78899ba7fa45 tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bd6cb3c-ded7-4aa4-804a-ce3927d0d806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:51:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-122180873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc392df5-e0b7-4cd3-b75b-d3681a190fa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fa054df8dd04aa49185baf39ad09316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:51:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:51:13Z,use_quota=True,user_id='ecc63534b53f4c1789a2195064ef0961',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:51:13 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b5a3007b-d231-4c4e-aa6a-78899ba7fa45 tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4c92f9c-abb3-4585-be2a-5c381cf8d72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:51:13 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b5a3007b-d231-4c4e-aa6a-78899ba7fa45 tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4c92f9c-abb3-4585-be2a-5c381cf8d72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:51:13 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b5a3007b-d231-4c4e-aa6a-78899ba7fa45 tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c9dfbfd-96f6-4810-97ab-0fc2541c1431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:51:13 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b5a3007b-d231-4c4e-aa6a-78899ba7fa45 tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c9dfbfd-96f6-4810-97ab-0fc2541c1431) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc392df5-e0b7-4cd3-b75b-d3681a190fa8', 'volume_name': 'volume-cc392df5-e0b7-4cd3-b75b-d3681a190fa8', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:51:13 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b5a3007b-d231-4c4e-aa6a-78899ba7fa45 tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f76f48b9-a766-4dd0-81df-fca8bf8c97b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:51:13 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b5a3007b-d231-4c4e-aa6a-78899ba7fa45 tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f76f48b9-a766-4dd0-81df-fca8bf8c97b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:51:13 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b5a3007b-d231-4c4e-aa6a-78899ba7fa45 tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf664b09-3f06-4f47-ad8d-640b0999ec77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:51:13 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-b5a3007b-d231-4c4e-aa6a-78899ba7fa45 tempest-VolumesActionsTest-941549806 None] Volume cc392df5-e0b7-4cd3-b75b-d3681a190fa8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc392df5-e0b7-4cd3-b75b-d3681a190fa8', 'volume_size': 1} Apr 24 13:51:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b5a3007b-d231-4c4e-aa6a-78899ba7fa45 tempest-VolumesActionsTest-941549806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:51:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b5a3007b-d231-4c4e-aa6a-78899ba7fa45 tempest-VolumesActionsTest-941549806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:51:13 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b5a3007b-d231-4c4e-aa6a-78899ba7fa45 tempest-VolumesActionsTest-941549806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:51:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-122180873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc392df5-e0b7-4cd3-b75b-d3681a190fa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fa054df8dd04aa49185baf39ad09316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:51:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:51:13Z,use_quota=True,user_id='ecc63534b53f4c1789a2195064ef0961',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:51:13 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-b5a3007b-d231-4c4e-aa6a-78899ba7fa45 tempest-VolumesActionsTest-941549806 None] Creating volume cc392df5-e0b7-4cd3-b75b-d3681a190fa8 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:51:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b5a3007b-d231-4c4e-aa6a-78899ba7fa45 tempest-VolumesActionsTest-941549806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:51:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b5a3007b-d231-4c4e-aa6a-78899ba7fa45 tempest-VolumesActionsTest-941549806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:51:13 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b5a3007b-d231-4c4e-aa6a-78899ba7fa45 tempest-VolumesActionsTest-941549806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:51:13 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b5a3007b-d231-4c4e-aa6a-78899ba7fa45 tempest-VolumesActionsTest-941549806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:51:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b5a3007b-d231-4c4e-aa6a-78899ba7fa45 tempest-VolumesActionsTest-941549806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:51:13 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b5a3007b-d231-4c4e-aa6a-78899ba7fa45 tempest-VolumesActionsTest-941549806 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:51:13 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-b5a3007b-d231-4c4e-aa6a-78899ba7fa45 tempest-VolumesActionsTest-941549806 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:51:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b5a3007b-d231-4c4e-aa6a-78899ba7fa45 tempest-VolumesActionsTest-941549806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc392df5-e0b7-4cd3-b75b-d3681a190fa8 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:51:13 devstack sudo[87708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc392df5-e0b7-4cd3-b75b-d3681a190fa8 1073741824 Apr 24 13:51:13 devstack sudo[87708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:51:14 devstack sudo[87706]: pam_unix(sudo:session): session closed for user root Apr 24 13:51:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-35132b6c-0a32-4f07-ac39-2839c5af2040 tempest-VolumesNegativeTest-570038845 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a4e0ee83-ee0e-4463-b7d6-bbdd8eb0ec1d" returned: 0 in 1.119s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:51:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-35132b6c-0a32-4f07-ac39-2839c5af2040 tempest-VolumesNegativeTest-570038845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a4e0ee83-ee0e-4463-b7d6-bbdd8eb0ec1d {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:51:14 devstack sudo[87713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a4e0ee83-ee0e-4463-b7d6-bbdd8eb0ec1d Apr 24 13:51:14 devstack sudo[87713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:51:14 devstack sudo[87708]: pam_unix(sudo:session): session closed for user root Apr 24 13:51:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b5a3007b-d231-4c4e-aa6a-78899ba7fa45 tempest-VolumesActionsTest-941549806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc392df5-e0b7-4cd3-b75b-d3681a190fa8 1073741824" returned: 0 in 0.882s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:51:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b5a3007b-d231-4c4e-aa6a-78899ba7fa45 tempest-VolumesActionsTest-941549806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc392df5-e0b7-4cd3-b75b-d3681a190fa8 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:51:14 devstack sudo[87718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc392df5-e0b7-4cd3-b75b-d3681a190fa8 Apr 24 13:51:14 devstack sudo[87718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:51:14 devstack sudo[87713]: pam_unix(sudo:session): session closed for user root Apr 24 13:51:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-35132b6c-0a32-4f07-ac39-2839c5af2040 tempest-VolumesNegativeTest-570038845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a4e0ee83-ee0e-4463-b7d6-bbdd8eb0ec1d" returned: 0 in 0.751s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:51:15 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-35132b6c-0a32-4f07-ac39-2839c5af2040 tempest-VolumesNegativeTest-570038845 None] Lock "cinder-quobyte-a4e0ee83-ee0e-4463-b7d6-bbdd8eb0ec1d" released by "delete_volume" :: held 1.980s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:51:15 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-35132b6c-0a32-4f07-ac39-2839c5af2040 tempest-VolumesNegativeTest-570038845 None] Created reservations ['8739384c-b51f-46a1-a4e6-06833cc2a34c', 'f4856953-c5a4-4ea1-b925-cd951860f03e', 'cb86e371-feee-448b-8f05-946c51cdaf71', 'f2544493-f94b-4f4d-b8ca-816602127639'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:51:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-35132b6c-0a32-4f07-ac39-2839c5af2040 tempest-VolumesNegativeTest-570038845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:51:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-35132b6c-0a32-4f07-ac39-2839c5af2040 tempest-VolumesNegativeTest-570038845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:51:15 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-35132b6c-0a32-4f07-ac39-2839c5af2040 tempest-VolumesNegativeTest-570038845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:51:15 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-35132b6c-0a32-4f07-ac39-2839c5af2040 tempest-VolumesNegativeTest-570038845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:51:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-35132b6c-0a32-4f07-ac39-2839c5af2040 tempest-VolumesNegativeTest-570038845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:51:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-35132b6c-0a32-4f07-ac39-2839c5af2040 tempest-VolumesNegativeTest-570038845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:51:15 devstack sudo[87721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:51:15 devstack sudo[87721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:51:15 devstack sudo[87718]: pam_unix(sudo:session): session closed for user root Apr 24 13:51:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b5a3007b-d231-4c4e-aa6a-78899ba7fa45 tempest-VolumesActionsTest-941549806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc392df5-e0b7-4cd3-b75b-d3681a190fa8" returned: 0 in 0.718s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:51:15 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b5a3007b-d231-4c4e-aa6a-78899ba7fa45 tempest-VolumesActionsTest-941549806 None] <== create_volume: return (1671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:51:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b5a3007b-d231-4c4e-aa6a-78899ba7fa45 tempest-VolumesActionsTest-941549806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.677s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:51:15 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b5a3007b-d231-4c4e-aa6a-78899ba7fa45 tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf664b09-3f06-4f47-ad8d-640b0999ec77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc392df5-e0b7-4cd3-b75b-d3681a190fa8', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:51:15 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b5a3007b-d231-4c4e-aa6a-78899ba7fa45 tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (397bd12a-f1be-4c85-aeb9-1026548c9439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:51:15 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-b5a3007b-d231-4c4e-aa6a-78899ba7fa45 tempest-VolumesActionsTest-941549806 None] Volume volume-cc392df5-e0b7-4cd3-b75b-d3681a190fa8 (cc392df5-e0b7-4cd3-b75b-d3681a190fa8): created successfully Apr 24 13:51:15 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b5a3007b-d231-4c4e-aa6a-78899ba7fa45 tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (397bd12a-f1be-4c85-aeb9-1026548c9439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:51:15 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b5a3007b-d231-4c4e-aa6a-78899ba7fa45 tempest-VolumesActionsTest-941549806 None] Flow 'volume_create_manager' (c508a0fe-1149-4d33-baca-525786af28bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:51:15 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-b5a3007b-d231-4c4e-aa6a-78899ba7fa45 tempest-VolumesActionsTest-941549806 None] Created volume successfully. Apr 24 13:51:15 devstack sudo[87721]: pam_unix(sudo:session): session closed for user root Apr 24 13:51:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-35132b6c-0a32-4f07-ac39-2839c5af2040 tempest-VolumesNegativeTest-570038845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.766s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:51:15 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-35132b6c-0a32-4f07-ac39-2839c5af2040 tempest-VolumesNegativeTest-570038845 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:51:15 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-35132b6c-0a32-4f07-ac39-2839c5af2040 tempest-VolumesNegativeTest-570038845 None] Deleted volume successfully. Apr 24 13:51:15 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-35132b6c-0a32-4f07-ac39-2839c5af2040 tempest-VolumesNegativeTest-570038845 None] Lock "cinder-a4e0ee83-ee0e-4463-b7d6-bbdd8eb0ec1d-delete_volume" released by "delete_volume" :: held 3.037s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:51:17 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-02632dce-a8ae-4f11-b3b5-4c4552b244e6 tempest-VolumesActionsTest-1607067325 None] Acquiring lock "cinder-cc392df5-e0b7-4cd3-b75b-d3681a190fa8-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:51:17 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-02632dce-a8ae-4f11-b3b5-4c4552b244e6 tempest-VolumesActionsTest-1607067325 None] Lock "cinder-cc392df5-e0b7-4cd3-b75b-d3681a190fa8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:51:17 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-02632dce-a8ae-4f11-b3b5-4c4552b244e6 tempest-VolumesActionsTest-1607067325 None] Acquiring lock "cinder-quobyte-cc392df5-e0b7-4cd3-b75b-d3681a190fa8" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:51:17 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-02632dce-a8ae-4f11-b3b5-4c4552b244e6 tempest-VolumesActionsTest-1607067325 None] Lock "cinder-quobyte-cc392df5-e0b7-4cd3-b75b-d3681a190fa8" acquired by "delete_volume" :: waited 0.062s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:51:17 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa0106c-7476-4587-83b3-0c2e4e6a374b]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:51:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-02632dce-a8ae-4f11-b3b5-4c4552b244e6 tempest-VolumesActionsTest-1607067325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc392df5-e0b7-4cd3-b75b-d3681a190fa8 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:51:17 devstack sudo[87787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc392df5-e0b7-4cd3-b75b-d3681a190fa8 Apr 24 13:51:17 devstack sudo[87787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:51:18 devstack sudo[87787]: pam_unix(sudo:session): session closed for user root Apr 24 13:51:18 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-02632dce-a8ae-4f11-b3b5-4c4552b244e6 tempest-VolumesActionsTest-1607067325 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc392df5-e0b7-4cd3-b75b-d3681a190fa8" returned: 0 in 0.723s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:51:18 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-02632dce-a8ae-4f11-b3b5-4c4552b244e6 tempest-VolumesActionsTest-1607067325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc392df5-e0b7-4cd3-b75b-d3681a190fa8 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:51:18 devstack sudo[87798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc392df5-e0b7-4cd3-b75b-d3681a190fa8 Apr 24 13:51:18 devstack sudo[87798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:51:18 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f260b3e3-1ac1-42ee-bcce-a591cd088bde tempest-VolumesActionsTest-1194041985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:51:18 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f260b3e3-1ac1-42ee-bcce-a591cd088bde tempest-VolumesActionsTest-1194041985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:51:19 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4b4c57-0930-4d0d-960a-da1323f6a3ca]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:51:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f260b3e3-1ac1-42ee-bcce-a591cd088bde tempest-VolumesActionsTest-1194041985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:51:19 devstack sudo[87798]: pam_unix(sudo:session): session closed for user root Apr 24 13:51:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-02632dce-a8ae-4f11-b3b5-4c4552b244e6 tempest-VolumesActionsTest-1607067325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-cc392df5-e0b7-4cd3-b75b-d3681a190fa8" returned: 0 in 0.676s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:51:19 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-02632dce-a8ae-4f11-b3b5-4c4552b244e6 tempest-VolumesActionsTest-1607067325 None] Lock "cinder-quobyte-cc392df5-e0b7-4cd3-b75b-d3681a190fa8" released by "delete_volume" :: held 1.468s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:51:19 devstack sudo[87801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7 Apr 24 13:51:19 devstack sudo[87801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:51:19 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-02632dce-a8ae-4f11-b3b5-4c4552b244e6 tempest-VolumesActionsTest-1607067325 None] Created reservations ['86fe5a14-59ee-48d6-ac97-0e2217077221', '18f4aca6-9bb9-42c8-8399-5853df1fd6b8', '19c892ef-7aaf-48ca-9783-9c259e349b7a', 'b923c124-4bf2-4eb6-829a-038bc51878a9'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:51:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-02632dce-a8ae-4f11-b3b5-4c4552b244e6 tempest-VolumesActionsTest-1607067325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:51:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-02632dce-a8ae-4f11-b3b5-4c4552b244e6 tempest-VolumesActionsTest-1607067325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:51:19 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-02632dce-a8ae-4f11-b3b5-4c4552b244e6 tempest-VolumesActionsTest-1607067325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:51:19 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-02632dce-a8ae-4f11-b3b5-4c4552b244e6 tempest-VolumesActionsTest-1607067325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:51:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-02632dce-a8ae-4f11-b3b5-4c4552b244e6 tempest-VolumesActionsTest-1607067325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:51:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-02632dce-a8ae-4f11-b3b5-4c4552b244e6 tempest-VolumesActionsTest-1607067325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:51:19 devstack sudo[87803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:51:19 devstack sudo[87803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:51:19 devstack sudo[87801]: pam_unix(sudo:session): session closed for user root Apr 24 13:51:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f260b3e3-1ac1-42ee-bcce-a591cd088bde tempest-VolumesActionsTest-1194041985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7" returned: 0 in 0.805s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:51:19 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead1b278-2c54-417d-a365-70904fcdafc0]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:51:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f260b3e3-1ac1-42ee-bcce-a591cd088bde tempest-VolumesActionsTest-1194041985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:51:19 devstack sudo[87803]: pam_unix(sudo:session): session closed for user root Apr 24 13:51:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-02632dce-a8ae-4f11-b3b5-4c4552b244e6 tempest-VolumesActionsTest-1607067325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.586s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:51:19 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-02632dce-a8ae-4f11-b3b5-4c4552b244e6 tempest-VolumesActionsTest-1607067325 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:51:19 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-02632dce-a8ae-4f11-b3b5-4c4552b244e6 tempest-VolumesActionsTest-1607067325 None] Deleted volume successfully. Apr 24 13:51:19 devstack sudo[87830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7 Apr 24 13:51:19 devstack sudo[87830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:51:20 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-02632dce-a8ae-4f11-b3b5-4c4552b244e6 tempest-VolumesActionsTest-1607067325 None] Lock "cinder-cc392df5-e0b7-4cd3-b75b-d3681a190fa8-delete_volume" released by "delete_volume" :: held 2.451s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:51:20 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5194087-6e1d-418f-8c87-47b18a0887a6 tempest-VolumesActionsTest-941549806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:51:20 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a5194087-6e1d-418f-8c87-47b18a0887a6 tempest-VolumesActionsTest-941549806 None] Flow 'volume_create_manager' (9de2a700-49b5-4d7a-a5fe-27c2bca873c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:51:20 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a5194087-6e1d-418f-8c87-47b18a0887a6 tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e419275-1d23-493c-b3ba-6107dd6dbacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:51:20 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a5194087-6e1d-418f-8c87-47b18a0887a6 tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e419275-1d23-493c-b3ba-6107dd6dbacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-425175588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7ff3be6-a1bd-4b8e-8bc9-45569a5c0f43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fa054df8dd04aa49185baf39ad09316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:51:20Z,use_quota=True,user_id='ecc63534b53f4c1789a2195064ef0961',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:51:20 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a5194087-6e1d-418f-8c87-47b18a0887a6 tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24743b6a-b7cd-4bf2-97b1-410725c4e01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:51:20 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a5194087-6e1d-418f-8c87-47b18a0887a6 tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24743b6a-b7cd-4bf2-97b1-410725c4e01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:51:20 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a5194087-6e1d-418f-8c87-47b18a0887a6 tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88fc67f6-561b-47ca-b47e-c5214fbc5371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:51:20 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a5194087-6e1d-418f-8c87-47b18a0887a6 tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88fc67f6-561b-47ca-b47e-c5214fbc5371) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7ff3be6-a1bd-4b8e-8bc9-45569a5c0f43', 'volume_name': 'volume-d7ff3be6-a1bd-4b8e-8bc9-45569a5c0f43', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:51:20 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a5194087-6e1d-418f-8c87-47b18a0887a6 tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b210685b-43e7-4f52-b244-63bccf06d1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:51:20 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a5194087-6e1d-418f-8c87-47b18a0887a6 tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b210685b-43e7-4f52-b244-63bccf06d1ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:51:20 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a5194087-6e1d-418f-8c87-47b18a0887a6 tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da82b6ec-b829-48d2-aac4-fcc7f4a71086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:51:20 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-a5194087-6e1d-418f-8c87-47b18a0887a6 tempest-VolumesActionsTest-941549806 None] Volume d7ff3be6-a1bd-4b8e-8bc9-45569a5c0f43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7ff3be6-a1bd-4b8e-8bc9-45569a5c0f43', 'volume_size': 1} Apr 24 13:51:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a5194087-6e1d-418f-8c87-47b18a0887a6 tempest-VolumesActionsTest-941549806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:51:20 devstack sudo[87830]: pam_unix(sudo:session): session closed for user root Apr 24 13:51:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f260b3e3-1ac1-42ee-bcce-a591cd088bde tempest-VolumesActionsTest-1194041985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7" returned: 0 in 0.813s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:51:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f260b3e3-1ac1-42ee-bcce-a591cd088bde tempest-VolumesActionsTest-1194041985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7 /opt/stack/data/cinder/conversion/9c88cc0b-6770-4aeb-97a9-5f99694b5dd7.temp_image.28819dd2-b4ef-4410-b7c1-41404307b43ffi55gg41.img {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:51:20 devstack sudo[87842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7 /opt/stack/data/cinder/conversion/9c88cc0b-6770-4aeb-97a9-5f99694b5dd7.temp_image.28819dd2-b4ef-4410-b7c1-41404307b43ffi55gg41.img Apr 24 13:51:20 devstack sudo[87842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:51:26 devstack sudo[87842]: pam_unix(sudo:session): session closed for user root Apr 24 13:51:27 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f260b3e3-1ac1-42ee-bcce-a591cd088bde tempest-VolumesActionsTest-1194041985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7 /opt/stack/data/cinder/conversion/9c88cc0b-6770-4aeb-97a9-5f99694b5dd7.temp_image.28819dd2-b4ef-4410-b7c1-41404307b43ffi55gg41.img" returned: 0 in 6.313s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:51:27 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[63379585-c5c3-4891-b2ce-30ad0b260cde]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:51:27 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f260b3e3-1ac1-42ee-bcce-a591cd088bde tempest-VolumesActionsTest-1194041985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:51:27 devstack sudo[87903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7 Apr 24 13:51:27 devstack sudo[87903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:51:27 devstack sudo[87903]: pam_unix(sudo:session): session closed for user root Apr 24 13:51:27 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f260b3e3-1ac1-42ee-bcce-a591cd088bde tempest-VolumesActionsTest-1194041985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7" returned: 0 in 0.787s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:51:27 devstack cinder-volume[82046]: DEBUG cinder.image.image_utils [None req-f260b3e3-1ac1-42ee-bcce-a591cd088bde tempest-VolumesActionsTest-1194041985 None] Image conversion details: src /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7, size 1024.00 MB, duration 6.31 sec, destination /opt/stack/data/cinder/conversion/9c88cc0b-6770-4aeb-97a9-5f99694b5dd7.temp_image.28819dd2-b4ef-4410-b7c1-41404307b43ffi55gg41.img {{(pid=82046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 13:51:27 devstack cinder-volume[82046]: INFO cinder.image.image_utils [None req-f260b3e3-1ac1-42ee-bcce-a591cd088bde tempest-VolumesActionsTest-1194041985 None] Converted 1024.00 MB image at 162.17 MB/s Apr 24 13:51:27 devstack cinder-volume[82046]: DEBUG cinder.image.image_utils [None req-f260b3e3-1ac1-42ee-bcce-a591cd088bde tempest-VolumesActionsTest-1194041985 None] 28819dd2-b4ef-4410-b7c1-41404307b43f was raw, no need to convert to raw {{(pid=82046) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 24 13:51:30 devstack cinder-volume[82046]: DEBUG dbcounter [-] [82046] Writing DB stats cinder:UPDATE=62,cinder:SELECT=43,cinder:INSERT=11,cinder:DELETE=4 {{(pid=82046) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 13:51:34 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-74ae97d2-8fa4-47db-8a2f-6a4c0666cae5 tempest-ServerRescueNegativeTestJSON-75264286 None] Acquiring lock "cinder-23849847-92bf-47ff-913e-f0d795e7598b-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:51:34 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-74ae97d2-8fa4-47db-8a2f-6a4c0666cae5 tempest-ServerRescueNegativeTestJSON-75264286 None] Lock "cinder-23849847-92bf-47ff-913e-f0d795e7598b-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:51:34 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-74ae97d2-8fa4-47db-8a2f-6a4c0666cae5 tempest-ServerRescueNegativeTestJSON-75264286 None] Acquiring lock "cinder-quobyte-23849847-92bf-47ff-913e-f0d795e7598b" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:51:34 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-74ae97d2-8fa4-47db-8a2f-6a4c0666cae5 tempest-ServerRescueNegativeTestJSON-75264286 None] Lock "cinder-quobyte-23849847-92bf-47ff-913e-f0d795e7598b" acquired by "delete_volume" :: waited 0.029s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:51:34 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[5072f4fc-a0e1-486e-bad8-925f04618643]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:51:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-74ae97d2-8fa4-47db-8a2f-6a4c0666cae5 tempest-ServerRescueNegativeTestJSON-75264286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-23849847-92bf-47ff-913e-f0d795e7598b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:51:34 devstack sudo[87982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-23849847-92bf-47ff-913e-f0d795e7598b Apr 24 13:51:34 devstack sudo[87982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:51:35 devstack sudo[87982]: pam_unix(sudo:session): session closed for user root Apr 24 13:51:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-74ae97d2-8fa4-47db-8a2f-6a4c0666cae5 tempest-ServerRescueNegativeTestJSON-75264286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-23849847-92bf-47ff-913e-f0d795e7598b" returned: 0 in 0.890s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:51:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-74ae97d2-8fa4-47db-8a2f-6a4c0666cae5 tempest-ServerRescueNegativeTestJSON-75264286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-23849847-92bf-47ff-913e-f0d795e7598b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:51:35 devstack sudo[87987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-23849847-92bf-47ff-913e-f0d795e7598b Apr 24 13:51:35 devstack sudo[87987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:51:36 devstack sudo[87987]: pam_unix(sudo:session): session closed for user root Apr 24 13:51:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-74ae97d2-8fa4-47db-8a2f-6a4c0666cae5 tempest-ServerRescueNegativeTestJSON-75264286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-23849847-92bf-47ff-913e-f0d795e7598b" returned: 0 in 0.941s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:51:36 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-74ae97d2-8fa4-47db-8a2f-6a4c0666cae5 tempest-ServerRescueNegativeTestJSON-75264286 None] Lock "cinder-quobyte-23849847-92bf-47ff-913e-f0d795e7598b" released by "delete_volume" :: held 1.884s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:51:36 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-74ae97d2-8fa4-47db-8a2f-6a4c0666cae5 tempest-ServerRescueNegativeTestJSON-75264286 None] Created reservations ['8630fca9-2671-45f8-bf83-cd160fc26b2f', '7e9539cc-f466-44cb-96e8-276f81af48bc', '96437cf2-bacf-4229-97d4-ae13f07d1101', '07018e22-6776-44cb-87fb-b04605e04113'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:51:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-74ae97d2-8fa4-47db-8a2f-6a4c0666cae5 tempest-ServerRescueNegativeTestJSON-75264286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:51:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-74ae97d2-8fa4-47db-8a2f-6a4c0666cae5 tempest-ServerRescueNegativeTestJSON-75264286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:51:36 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-74ae97d2-8fa4-47db-8a2f-6a4c0666cae5 tempest-ServerRescueNegativeTestJSON-75264286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:51:36 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-74ae97d2-8fa4-47db-8a2f-6a4c0666cae5 tempest-ServerRescueNegativeTestJSON-75264286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:51:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-74ae97d2-8fa4-47db-8a2f-6a4c0666cae5 tempest-ServerRescueNegativeTestJSON-75264286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:51:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-74ae97d2-8fa4-47db-8a2f-6a4c0666cae5 tempest-ServerRescueNegativeTestJSON-75264286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:51:36 devstack sudo[87995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:51:36 devstack sudo[87995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:51:37 devstack sudo[87995]: pam_unix(sudo:session): session closed for user root Apr 24 13:51:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-74ae97d2-8fa4-47db-8a2f-6a4c0666cae5 tempest-ServerRescueNegativeTestJSON-75264286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.863s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:51:37 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-74ae97d2-8fa4-47db-8a2f-6a4c0666cae5 tempest-ServerRescueNegativeTestJSON-75264286 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:51:37 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-74ae97d2-8fa4-47db-8a2f-6a4c0666cae5 tempest-ServerRescueNegativeTestJSON-75264286 None] Deleted volume successfully. Apr 24 13:51:37 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-74ae97d2-8fa4-47db-8a2f-6a4c0666cae5 tempest-ServerRescueNegativeTestJSON-75264286 None] Lock "cinder-23849847-92bf-47ff-913e-f0d795e7598b-delete_volume" released by "delete_volume" :: held 3.328s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:51:37 devstack cinder-volume[82046]: DEBUG oslo_service.periodic_task [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82046) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 13:51:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:51:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:51:37 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:51:37 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:51:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.070s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:51:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:51:38 devstack sudo[88024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:51:38 devstack sudo[88024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:51:39 devstack sudo[88024]: pam_unix(sudo:session): session closed for user root Apr 24 13:51:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 1.181s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:51:39 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:51:46 devstack cinder-volume[82046]: DEBUG dbcounter [-] [82046] Writing DB stats cinder:SELECT=4,cinder:UPDATE=14,cinder:INSERT=3 {{(pid=82046) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 13:51:47 devstack cinder-volume[82046]: DEBUG dbcounter [-] [82046] Writing DB stats cinder:SELECT=51,cinder:INSERT=17,cinder:UPDATE=58,cinder:DELETE=7 {{(pid=82046) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 13:51:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f260b3e3-1ac1-42ee-bcce-a591cd088bde tempest-VolumesActionsTest-1194041985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.995s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:51:48 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f260b3e3-1ac1-42ee-bcce-a591cd088bde tempest-VolumesActionsTest-1194041985 None] Uploaded volume to glance image-id: 28819dd2-b4ef-4410-b7c1-41404307b43f. {{(pid=82046) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 24 13:51:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a5194087-6e1d-418f-8c87-47b18a0887a6 tempest-VolumesActionsTest-941549806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 28.431s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:51:48 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a5194087-6e1d-418f-8c87-47b18a0887a6 tempest-VolumesActionsTest-941549806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-425175588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7ff3be6-a1bd-4b8e-8bc9-45569a5c0f43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fa054df8dd04aa49185baf39ad09316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:51:20Z,use_quota=True,user_id='ecc63534b53f4c1789a2195064ef0961',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:51:48 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-a5194087-6e1d-418f-8c87-47b18a0887a6 tempest-VolumesActionsTest-941549806 None] Creating volume d7ff3be6-a1bd-4b8e-8bc9-45569a5c0f43 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:51:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a5194087-6e1d-418f-8c87-47b18a0887a6 tempest-VolumesActionsTest-941549806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:51:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a5194087-6e1d-418f-8c87-47b18a0887a6 tempest-VolumesActionsTest-941549806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:51:48 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a5194087-6e1d-418f-8c87-47b18a0887a6 tempest-VolumesActionsTest-941549806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:51:48 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a5194087-6e1d-418f-8c87-47b18a0887a6 tempest-VolumesActionsTest-941549806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:51:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a5194087-6e1d-418f-8c87-47b18a0887a6 tempest-VolumesActionsTest-941549806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:51:48 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a5194087-6e1d-418f-8c87-47b18a0887a6 tempest-VolumesActionsTest-941549806 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:51:48 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-a5194087-6e1d-418f-8c87-47b18a0887a6 tempest-VolumesActionsTest-941549806 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:51:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a5194087-6e1d-418f-8c87-47b18a0887a6 tempest-VolumesActionsTest-941549806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d7ff3be6-a1bd-4b8e-8bc9-45569a5c0f43 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:51:49 devstack sudo[88099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d7ff3be6-a1bd-4b8e-8bc9-45569a5c0f43 1073741824 Apr 24 13:51:49 devstack sudo[88099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:51:49 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-f260b3e3-1ac1-42ee-bcce-a591cd088bde tempest-VolumesActionsTest-1194041985 None] Copy volume to image completed successfully. Apr 24 13:51:49 devstack sudo[88099]: pam_unix(sudo:session): session closed for user root Apr 24 13:51:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a5194087-6e1d-418f-8c87-47b18a0887a6 tempest-VolumesActionsTest-941549806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d7ff3be6-a1bd-4b8e-8bc9-45569a5c0f43 1073741824" returned: 0 in 0.678s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:51:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a5194087-6e1d-418f-8c87-47b18a0887a6 tempest-VolumesActionsTest-941549806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d7ff3be6-a1bd-4b8e-8bc9-45569a5c0f43 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:51:49 devstack sudo[88110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d7ff3be6-a1bd-4b8e-8bc9-45569a5c0f43 Apr 24 13:51:49 devstack sudo[88110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:51:50 devstack sudo[88110]: pam_unix(sudo:session): session closed for user root Apr 24 13:51:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a5194087-6e1d-418f-8c87-47b18a0887a6 tempest-VolumesActionsTest-941549806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d7ff3be6-a1bd-4b8e-8bc9-45569a5c0f43" returned: 0 in 0.504s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:51:50 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a5194087-6e1d-418f-8c87-47b18a0887a6 tempest-VolumesActionsTest-941549806 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:51:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a5194087-6e1d-418f-8c87-47b18a0887a6 tempest-VolumesActionsTest-941549806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:51:50 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a5194087-6e1d-418f-8c87-47b18a0887a6 tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da82b6ec-b829-48d2-aac4-fcc7f4a71086) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7ff3be6-a1bd-4b8e-8bc9-45569a5c0f43', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:51:50 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a5194087-6e1d-418f-8c87-47b18a0887a6 tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (769802a3-7da8-4012-8ef6-48b6252ddc13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:51:50 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-a5194087-6e1d-418f-8c87-47b18a0887a6 tempest-VolumesActionsTest-941549806 None] Volume volume-d7ff3be6-a1bd-4b8e-8bc9-45569a5c0f43 (d7ff3be6-a1bd-4b8e-8bc9-45569a5c0f43): created successfully Apr 24 13:51:50 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a5194087-6e1d-418f-8c87-47b18a0887a6 tempest-VolumesActionsTest-941549806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (769802a3-7da8-4012-8ef6-48b6252ddc13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:51:50 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a5194087-6e1d-418f-8c87-47b18a0887a6 tempest-VolumesActionsTest-941549806 None] Flow 'volume_create_manager' (9de2a700-49b5-4d7a-a5fe-27c2bca873c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:51:50 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-a5194087-6e1d-418f-8c87-47b18a0887a6 tempest-VolumesActionsTest-941549806 None] Created volume successfully. Apr 24 13:51:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-e8924608-df17-4e4d-a758-d70412b93b9d tempest-VolumesActionsTest-1194041985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:51:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-e8924608-df17-4e4d-a758-d70412b93b9d tempest-VolumesActionsTest-1194041985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:51:50 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[b989037d-47f9-4cec-8d6c-d747c8b95a16]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:51:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e8924608-df17-4e4d-a758-d70412b93b9d tempest-VolumesActionsTest-1194041985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:51:50 devstack sudo[88113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7 Apr 24 13:51:50 devstack sudo[88113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:51:51 devstack sudo[88113]: pam_unix(sudo:session): session closed for user root Apr 24 13:51:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e8924608-df17-4e4d-a758-d70412b93b9d tempest-VolumesActionsTest-1194041985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7" returned: 0 in 0.666s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:51:51 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1f49ed-ad8f-4e1f-8bb6-0fa2390560e2]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:51:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e8924608-df17-4e4d-a758-d70412b93b9d tempest-VolumesActionsTest-1194041985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:51:51 devstack sudo[88118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7 Apr 24 13:51:51 devstack sudo[88118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:51:51 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-581b37c7-a0c4-4ca5-82ab-3a409790ca52 tempest-VolumesActionsTest-941549806 None] Acquiring lock "cinder-d7ff3be6-a1bd-4b8e-8bc9-45569a5c0f43-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:51:51 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-581b37c7-a0c4-4ca5-82ab-3a409790ca52 tempest-VolumesActionsTest-941549806 None] Lock "cinder-d7ff3be6-a1bd-4b8e-8bc9-45569a5c0f43-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:51:51 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-581b37c7-a0c4-4ca5-82ab-3a409790ca52 tempest-VolumesActionsTest-941549806 None] Acquiring lock "cinder-quobyte-d7ff3be6-a1bd-4b8e-8bc9-45569a5c0f43" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:51:51 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-581b37c7-a0c4-4ca5-82ab-3a409790ca52 tempest-VolumesActionsTest-941549806 None] Lock "cinder-quobyte-d7ff3be6-a1bd-4b8e-8bc9-45569a5c0f43" acquired by "delete_volume" :: waited 0.016s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:51:51 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5f5d93-b293-4cd1-8d70-b440e45fbfdc]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:51:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-581b37c7-a0c4-4ca5-82ab-3a409790ca52 tempest-VolumesActionsTest-941549806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d7ff3be6-a1bd-4b8e-8bc9-45569a5c0f43 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:51:51 devstack sudo[88120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d7ff3be6-a1bd-4b8e-8bc9-45569a5c0f43 Apr 24 13:51:51 devstack sudo[88120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:51:51 devstack sudo[88118]: pam_unix(sudo:session): session closed for user root Apr 24 13:51:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e8924608-df17-4e4d-a758-d70412b93b9d tempest-VolumesActionsTest-1194041985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7" returned: 0 in 0.636s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:51:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e8924608-df17-4e4d-a758-d70412b93b9d tempest-VolumesActionsTest-1194041985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7 /opt/stack/data/cinder/conversion/9c88cc0b-6770-4aeb-97a9-5f99694b5dd7.temp_image.4aca87cc-a059-4944-a201-42bb87a2bfd0wz4rzo8l.img {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:51:51 devstack sudo[88125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7 /opt/stack/data/cinder/conversion/9c88cc0b-6770-4aeb-97a9-5f99694b5dd7.temp_image.4aca87cc-a059-4944-a201-42bb87a2bfd0wz4rzo8l.img Apr 24 13:51:51 devstack sudo[88125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:51:52 devstack sudo[88120]: pam_unix(sudo:session): session closed for user root Apr 24 13:51:52 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-581b37c7-a0c4-4ca5-82ab-3a409790ca52 tempest-VolumesActionsTest-941549806 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d7ff3be6-a1bd-4b8e-8bc9-45569a5c0f43" returned: 0 in 0.594s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:51:52 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-581b37c7-a0c4-4ca5-82ab-3a409790ca52 tempest-VolumesActionsTest-941549806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d7ff3be6-a1bd-4b8e-8bc9-45569a5c0f43 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:51:52 devstack sudo[88130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d7ff3be6-a1bd-4b8e-8bc9-45569a5c0f43 Apr 24 13:51:52 devstack sudo[88130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:51:52 devstack sudo[88130]: pam_unix(sudo:session): session closed for user root Apr 24 13:51:52 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-581b37c7-a0c4-4ca5-82ab-3a409790ca52 tempest-VolumesActionsTest-941549806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d7ff3be6-a1bd-4b8e-8bc9-45569a5c0f43" returned: 0 in 0.697s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:51:52 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-581b37c7-a0c4-4ca5-82ab-3a409790ca52 tempest-VolumesActionsTest-941549806 None] Lock "cinder-quobyte-d7ff3be6-a1bd-4b8e-8bc9-45569a5c0f43" released by "delete_volume" :: held 1.374s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:51:52 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-581b37c7-a0c4-4ca5-82ab-3a409790ca52 tempest-VolumesActionsTest-941549806 None] Created reservations ['ff642505-3d9c-493a-b9d2-21575bce1eac', 'c9dc2b8a-fb13-4d17-8aef-80d173732bc7', '28002185-61ae-4510-8433-e84cfd5fc9c0', 'af640547-fa42-4cef-8d06-e5aa80ae0403'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:51:52 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-581b37c7-a0c4-4ca5-82ab-3a409790ca52 tempest-VolumesActionsTest-941549806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:51:52 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-581b37c7-a0c4-4ca5-82ab-3a409790ca52 tempest-VolumesActionsTest-941549806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:51:52 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-581b37c7-a0c4-4ca5-82ab-3a409790ca52 tempest-VolumesActionsTest-941549806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:51:52 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-581b37c7-a0c4-4ca5-82ab-3a409790ca52 tempest-VolumesActionsTest-941549806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:51:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-581b37c7-a0c4-4ca5-82ab-3a409790ca52 tempest-VolumesActionsTest-941549806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:51:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-581b37c7-a0c4-4ca5-82ab-3a409790ca52 tempest-VolumesActionsTest-941549806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:51:53 devstack sudo[88143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:51:53 devstack sudo[88143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:51:54 devstack sudo[88143]: pam_unix(sudo:session): session closed for user root Apr 24 13:51:54 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-581b37c7-a0c4-4ca5-82ab-3a409790ca52 tempest-VolumesActionsTest-941549806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 1.139s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:51:54 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-581b37c7-a0c4-4ca5-82ab-3a409790ca52 tempest-VolumesActionsTest-941549806 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:51:54 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-581b37c7-a0c4-4ca5-82ab-3a409790ca52 tempest-VolumesActionsTest-941549806 None] Deleted volume successfully. Apr 24 13:51:54 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-581b37c7-a0c4-4ca5-82ab-3a409790ca52 tempest-VolumesActionsTest-941549806 None] Lock "cinder-d7ff3be6-a1bd-4b8e-8bc9-45569a5c0f43-delete_volume" released by "delete_volume" :: held 2.919s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:51:57 devstack sudo[88125]: pam_unix(sudo:session): session closed for user root Apr 24 13:51:57 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e8924608-df17-4e4d-a758-d70412b93b9d tempest-VolumesActionsTest-1194041985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7 /opt/stack/data/cinder/conversion/9c88cc0b-6770-4aeb-97a9-5f99694b5dd7.temp_image.4aca87cc-a059-4944-a201-42bb87a2bfd0wz4rzo8l.img" returned: 0 in 5.837s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:51:57 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f63e436-eab0-4ef9-a0bf-eecf8a3567d5]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:51:57 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e8924608-df17-4e4d-a758-d70412b93b9d tempest-VolumesActionsTest-1194041985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:51:57 devstack sudo[88150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7 Apr 24 13:51:57 devstack sudo[88150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:51:58 devstack sudo[88150]: pam_unix(sudo:session): session closed for user root Apr 24 13:51:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e8924608-df17-4e4d-a758-d70412b93b9d tempest-VolumesActionsTest-1194041985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7" returned: 0 in 0.871s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:51:58 devstack cinder-volume[82046]: DEBUG cinder.image.image_utils [None req-e8924608-df17-4e4d-a758-d70412b93b9d tempest-VolumesActionsTest-1194041985 None] Image conversion details: src /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7, size 1024.00 MB, duration 5.84 sec, destination /opt/stack/data/cinder/conversion/9c88cc0b-6770-4aeb-97a9-5f99694b5dd7.temp_image.4aca87cc-a059-4944-a201-42bb87a2bfd0wz4rzo8l.img {{(pid=82046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 13:51:58 devstack cinder-volume[82046]: INFO cinder.image.image_utils [None req-e8924608-df17-4e4d-a758-d70412b93b9d tempest-VolumesActionsTest-1194041985 None] Converted 1024.00 MB image at 175.39 MB/s Apr 24 13:51:58 devstack cinder-volume[82046]: DEBUG cinder.image.image_utils [None req-e8924608-df17-4e4d-a758-d70412b93b9d tempest-VolumesActionsTest-1194041985 None] 4aca87cc-a059-4944-a201-42bb87a2bfd0 was raw, converting to qcow2 {{(pid=82046) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 24 13:51:58 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[4abeba07-0da0-4edd-ae74-c568f8cc6b08]: (4, 'raw') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:51:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e8924608-df17-4e4d-a758-d70412b93b9d tempest-VolumesActionsTest-1194041985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9c88cc0b-6770-4aeb-97a9-5f99694b5dd7.temp_image.4aca87cc-a059-4944-a201-42bb87a2bfd0wz4rzo8l.img {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:51:58 devstack sudo[88156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9c88cc0b-6770-4aeb-97a9-5f99694b5dd7.temp_image.4aca87cc-a059-4944-a201-42bb87a2bfd0wz4rzo8l.img Apr 24 13:51:58 devstack sudo[88156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:51:59 devstack sudo[88156]: pam_unix(sudo:session): session closed for user root Apr 24 13:51:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e8924608-df17-4e4d-a758-d70412b93b9d tempest-VolumesActionsTest-1194041985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9c88cc0b-6770-4aeb-97a9-5f99694b5dd7.temp_image.4aca87cc-a059-4944-a201-42bb87a2bfd0wz4rzo8l.img" returned: 0 in 0.703s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:51:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e8924608-df17-4e4d-a758-d70412b93b9d tempest-VolumesActionsTest-1194041985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9c88cc0b-6770-4aeb-97a9-5f99694b5dd7.temp_image.4aca87cc-a059-4944-a201-42bb87a2bfd0wz4rzo8l.img {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:51:59 devstack sudo[88161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9c88cc0b-6770-4aeb-97a9-5f99694b5dd7.temp_image.4aca87cc-a059-4944-a201-42bb87a2bfd0wz4rzo8l.img Apr 24 13:51:59 devstack sudo[88161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:51:59 devstack sudo[88161]: pam_unix(sudo:session): session closed for user root Apr 24 13:51:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e8924608-df17-4e4d-a758-d70412b93b9d tempest-VolumesActionsTest-1194041985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9c88cc0b-6770-4aeb-97a9-5f99694b5dd7.temp_image.4aca87cc-a059-4944-a201-42bb87a2bfd0wz4rzo8l.img" returned: 1 in 0.769s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:51:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e8924608-df17-4e4d-a758-d70412b93b9d tempest-VolumesActionsTest-1194041985 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9c88cc0b-6770-4aeb-97a9-5f99694b5dd7.temp_image.4aca87cc-a059-4944-a201-42bb87a2bfd0wz4rzo8l.img' failed. Not Retrying. {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 13:51:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e8924608-df17-4e4d-a758-d70412b93b9d tempest-VolumesActionsTest-1194041985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9c88cc0b-6770-4aeb-97a9-5f99694b5dd7.temp_image.4aca87cc-a059-4944-a201-42bb87a2bfd0wz4rzo8l.img /opt/stack/data/cinder/conversion/vol_upload_kfj4iw7x {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:00 devstack sudo[88167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9c88cc0b-6770-4aeb-97a9-5f99694b5dd7.temp_image.4aca87cc-a059-4944-a201-42bb87a2bfd0wz4rzo8l.img /opt/stack/data/cinder/conversion/vol_upload_kfj4iw7x Apr 24 13:52:00 devstack sudo[88167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:00 devstack sudo[88167]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:00 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e8924608-df17-4e4d-a758-d70412b93b9d tempest-VolumesActionsTest-1194041985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9c88cc0b-6770-4aeb-97a9-5f99694b5dd7.temp_image.4aca87cc-a059-4944-a201-42bb87a2bfd0wz4rzo8l.img /opt/stack/data/cinder/conversion/vol_upload_kfj4iw7x" returned: 0 in 0.598s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:00 devstack cinder-volume[82046]: DEBUG cinder.image.image_utils [None req-e8924608-df17-4e4d-a758-d70412b93b9d tempest-VolumesActionsTest-1194041985 None] Image conversion details: src /opt/stack/data/cinder/conversion/9c88cc0b-6770-4aeb-97a9-5f99694b5dd7.temp_image.4aca87cc-a059-4944-a201-42bb87a2bfd0wz4rzo8l.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_kfj4iw7x {{(pid=82046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 13:52:00 devstack cinder-volume[82046]: INFO cinder.image.image_utils [None req-e8924608-df17-4e4d-a758-d70412b93b9d tempest-VolumesActionsTest-1194041985 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 24 13:52:00 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cdecdfb-26e8-4c8f-ba5e-fda8e69ba4a0]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:52:00 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e8924608-df17-4e4d-a758-d70412b93b9d tempest-VolumesActionsTest-1194041985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_kfj4iw7x {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:00 devstack sudo[88172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_kfj4iw7x Apr 24 13:52:00 devstack sudo[88172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:01 devstack sudo[88172]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e8924608-df17-4e4d-a758-d70412b93b9d tempest-VolumesActionsTest-1194041985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_kfj4iw7x" returned: 0 in 0.781s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-e8924608-df17-4e4d-a758-d70412b93b9d tempest-VolumesActionsTest-1194041985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.839s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:52:03 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e8924608-df17-4e4d-a758-d70412b93b9d tempest-VolumesActionsTest-1194041985 None] Uploaded volume to glance image-id: 4aca87cc-a059-4944-a201-42bb87a2bfd0. {{(pid=82046) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 24 13:52:03 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-e8924608-df17-4e4d-a758-d70412b93b9d tempest-VolumesActionsTest-1194041985 None] Copy volume to image completed successfully. Apr 24 13:52:03 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc9510e3-ea90-43ca-aa03-09c364855a98 tempest-VolumesTestJSON-2030235813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:52:03 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-cc9510e3-ea90-43ca-aa03-09c364855a98 tempest-VolumesTestJSON-2030235813 None] Flow 'volume_create_manager' (630a205c-5573-49f1-8971-04d91a9d07b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:52:03 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-cc9510e3-ea90-43ca-aa03-09c364855a98 tempest-VolumesTestJSON-2030235813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6814699-3ccb-417c-9a00-934f86f99253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:03 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-cc9510e3-ea90-43ca-aa03-09c364855a98 tempest-VolumesTestJSON-2030235813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6814699-3ccb-417c-9a00-934f86f99253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1958852974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d4be63e-48eb-4b47-bcc4-e736b51eff8d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='01ed2757cd1046bca5320596edad5b61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:52:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:52:04Z,use_quota=True,user_id='c0138879011249afb7c1ed12220e1e1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:03 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-cc9510e3-ea90-43ca-aa03-09c364855a98 tempest-VolumesTestJSON-2030235813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63746389-8628-417f-8977-4b2ac2103be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:03 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-cc9510e3-ea90-43ca-aa03-09c364855a98 tempest-VolumesTestJSON-2030235813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63746389-8628-417f-8977-4b2ac2103be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:03 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-cc9510e3-ea90-43ca-aa03-09c364855a98 tempest-VolumesTestJSON-2030235813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c99fb49c-7576-4387-b5a6-653fe577eccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:03 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-cc9510e3-ea90-43ca-aa03-09c364855a98 tempest-VolumesTestJSON-2030235813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c99fb49c-7576-4387-b5a6-653fe577eccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d4be63e-48eb-4b47-bcc4-e736b51eff8d', 'volume_name': 'volume-8d4be63e-48eb-4b47-bcc4-e736b51eff8d', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:03 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-cc9510e3-ea90-43ca-aa03-09c364855a98 tempest-VolumesTestJSON-2030235813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7b8f979-6010-4ad4-8204-a9058557ace1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:03 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-cc9510e3-ea90-43ca-aa03-09c364855a98 tempest-VolumesTestJSON-2030235813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7b8f979-6010-4ad4-8204-a9058557ace1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:03 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-cc9510e3-ea90-43ca-aa03-09c364855a98 tempest-VolumesTestJSON-2030235813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19664aaf-2c26-4e67-8524-04c3d0302a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:03 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-cc9510e3-ea90-43ca-aa03-09c364855a98 tempest-VolumesTestJSON-2030235813 None] Volume 8d4be63e-48eb-4b47-bcc4-e736b51eff8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d4be63e-48eb-4b47-bcc4-e736b51eff8d', 'volume_size': 1} Apr 24 13:52:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-cc9510e3-ea90-43ca-aa03-09c364855a98 tempest-VolumesTestJSON-2030235813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:52:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-cc9510e3-ea90-43ca-aa03-09c364855a98 tempest-VolumesTestJSON-2030235813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:52:03 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-cc9510e3-ea90-43ca-aa03-09c364855a98 tempest-VolumesTestJSON-2030235813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1958852974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d4be63e-48eb-4b47-bcc4-e736b51eff8d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='01ed2757cd1046bca5320596edad5b61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:52:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:52:04Z,use_quota=True,user_id='c0138879011249afb7c1ed12220e1e1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:52:03 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-cc9510e3-ea90-43ca-aa03-09c364855a98 tempest-VolumesTestJSON-2030235813 None] Creating volume 8d4be63e-48eb-4b47-bcc4-e736b51eff8d {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:52:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-cc9510e3-ea90-43ca-aa03-09c364855a98 tempest-VolumesTestJSON-2030235813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:52:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-cc9510e3-ea90-43ca-aa03-09c364855a98 tempest-VolumesTestJSON-2030235813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:52:03 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-cc9510e3-ea90-43ca-aa03-09c364855a98 tempest-VolumesTestJSON-2030235813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:52:03 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-cc9510e3-ea90-43ca-aa03-09c364855a98 tempest-VolumesTestJSON-2030235813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:52:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-cc9510e3-ea90-43ca-aa03-09c364855a98 tempest-VolumesTestJSON-2030235813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:52:03 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-cc9510e3-ea90-43ca-aa03-09c364855a98 tempest-VolumesTestJSON-2030235813 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:52:03 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-cc9510e3-ea90-43ca-aa03-09c364855a98 tempest-VolumesTestJSON-2030235813 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:52:04 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-cc9510e3-ea90-43ca-aa03-09c364855a98 tempest-VolumesTestJSON-2030235813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-8d4be63e-48eb-4b47-bcc4-e736b51eff8d 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:04 devstack sudo[88179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-8d4be63e-48eb-4b47-bcc4-e736b51eff8d 1073741824 Apr 24 13:52:04 devstack sudo[88179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:04 devstack sudo[88179]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:04 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-cc9510e3-ea90-43ca-aa03-09c364855a98 tempest-VolumesTestJSON-2030235813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-8d4be63e-48eb-4b47-bcc4-e736b51eff8d 1073741824" returned: 0 in 0.773s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:04 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-c0040a3f-d17a-43ad-83dc-99363a7ceba2 tempest-VolumesActionsTest-1194041985 None] Acquiring lock "cinder-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:52:04 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-cc9510e3-ea90-43ca-aa03-09c364855a98 tempest-VolumesTestJSON-2030235813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-8d4be63e-48eb-4b47-bcc4-e736b51eff8d {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:04 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-c0040a3f-d17a-43ad-83dc-99363a7ceba2 tempest-VolumesActionsTest-1194041985 None] Lock "cinder-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:52:04 devstack sudo[88184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-8d4be63e-48eb-4b47-bcc4-e736b51eff8d Apr 24 13:52:04 devstack sudo[88184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:04 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-c0040a3f-d17a-43ad-83dc-99363a7ceba2 tempest-VolumesActionsTest-1194041985 None] Acquiring lock "cinder-quobyte-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:52:04 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-c0040a3f-d17a-43ad-83dc-99363a7ceba2 tempest-VolumesActionsTest-1194041985 None] Lock "cinder-quobyte-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7" acquired by "delete_volume" :: waited 0.024s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:52:04 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[d501be64-ffb7-43e4-9d08-59e03a3bdd50]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:52:04 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-c0040a3f-d17a-43ad-83dc-99363a7ceba2 tempest-VolumesActionsTest-1194041985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:05 devstack sudo[88186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7 Apr 24 13:52:05 devstack sudo[88186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:05 devstack sudo[88184]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:05 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-cc9510e3-ea90-43ca-aa03-09c364855a98 tempest-VolumesTestJSON-2030235813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-8d4be63e-48eb-4b47-bcc4-e736b51eff8d" returned: 0 in 0.561s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:05 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-cc9510e3-ea90-43ca-aa03-09c364855a98 tempest-VolumesTestJSON-2030235813 None] <== create_volume: return (1386ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:52:05 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-cc9510e3-ea90-43ca-aa03-09c364855a98 tempest-VolumesTestJSON-2030235813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.388s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:52:05 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-cc9510e3-ea90-43ca-aa03-09c364855a98 tempest-VolumesTestJSON-2030235813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19664aaf-2c26-4e67-8524-04c3d0302a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d4be63e-48eb-4b47-bcc4-e736b51eff8d', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:05 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-cc9510e3-ea90-43ca-aa03-09c364855a98 tempest-VolumesTestJSON-2030235813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9e04c70-ebb3-4abf-819a-10b8c78f047a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:05 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-cc9510e3-ea90-43ca-aa03-09c364855a98 tempest-VolumesTestJSON-2030235813 None] Volume volume-8d4be63e-48eb-4b47-bcc4-e736b51eff8d (8d4be63e-48eb-4b47-bcc4-e736b51eff8d): created successfully Apr 24 13:52:05 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-cc9510e3-ea90-43ca-aa03-09c364855a98 tempest-VolumesTestJSON-2030235813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9e04c70-ebb3-4abf-819a-10b8c78f047a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:05 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-cc9510e3-ea90-43ca-aa03-09c364855a98 tempest-VolumesTestJSON-2030235813 None] Flow 'volume_create_manager' (630a205c-5573-49f1-8971-04d91a9d07b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:52:05 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-cc9510e3-ea90-43ca-aa03-09c364855a98 tempest-VolumesTestJSON-2030235813 None] Created volume successfully. Apr 24 13:52:05 devstack sudo[88186]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:05 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-c0040a3f-d17a-43ad-83dc-99363a7ceba2 tempest-VolumesActionsTest-1194041985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7" returned: 0 in 0.672s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:05 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-c0040a3f-d17a-43ad-83dc-99363a7ceba2 tempest-VolumesActionsTest-1194041985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:05 devstack sudo[88194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7 Apr 24 13:52:05 devstack sudo[88194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:06 devstack sudo[88194]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-c0040a3f-d17a-43ad-83dc-99363a7ceba2 tempest-VolumesActionsTest-1194041985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7" returned: 0 in 0.519s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:06 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-c0040a3f-d17a-43ad-83dc-99363a7ceba2 tempest-VolumesActionsTest-1194041985 None] Lock "cinder-quobyte-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7" released by "delete_volume" :: held 1.259s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:52:06 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-c0040a3f-d17a-43ad-83dc-99363a7ceba2 tempest-VolumesActionsTest-1194041985 None] Created reservations ['dac9e7fb-b81c-4c41-a559-dcacb9b5b235', '54fa76b5-ea02-41cf-86e1-f9904941845a', 'dbd1f9c8-dfc5-465d-98e8-d6334de4ad95', '0bc2429b-99d0-4985-8101-250f75397e7f'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:52:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-c0040a3f-d17a-43ad-83dc-99363a7ceba2 tempest-VolumesActionsTest-1194041985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:52:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-c0040a3f-d17a-43ad-83dc-99363a7ceba2 tempest-VolumesActionsTest-1194041985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:52:06 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-c0040a3f-d17a-43ad-83dc-99363a7ceba2 tempest-VolumesActionsTest-1194041985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:52:06 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-c0040a3f-d17a-43ad-83dc-99363a7ceba2 tempest-VolumesActionsTest-1194041985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:52:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-c0040a3f-d17a-43ad-83dc-99363a7ceba2 tempest-VolumesActionsTest-1194041985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:52:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-c0040a3f-d17a-43ad-83dc-99363a7ceba2 tempest-VolumesActionsTest-1194041985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:06 devstack sudo[88197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:52:06 devstack sudo[88197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:07 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-6858bdb4-6044-45c8-a599-7733edad11ce tempest-VolumesTestJSON-2030235813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:52:07 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6858bdb4-6044-45c8-a599-7733edad11ce tempest-VolumesTestJSON-2030235813 None] Flow 'volume_create_manager' (f1b5c459-2ff8-4874-8573-a1185d02957d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:52:07 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6858bdb4-6044-45c8-a599-7733edad11ce tempest-VolumesTestJSON-2030235813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38b629c6-5263-4d29-bcaa-f0d4ec42748c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:07 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6858bdb4-6044-45c8-a599-7733edad11ce tempest-VolumesTestJSON-2030235813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38b629c6-5263-4d29-bcaa-f0d4ec42748c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:52:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-660284287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=721c9792-a3a0-4dfa-9839-cfb5cbd43d94,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='01ed2757cd1046bca5320596edad5b61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:52:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:52:07Z,use_quota=True,user_id='c0138879011249afb7c1ed12220e1e1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:07 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6858bdb4-6044-45c8-a599-7733edad11ce tempest-VolumesTestJSON-2030235813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7574f004-cd18-4ae0-a1b3-77571c93a23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:07 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6858bdb4-6044-45c8-a599-7733edad11ce tempest-VolumesTestJSON-2030235813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7574f004-cd18-4ae0-a1b3-77571c93a23a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:07 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6858bdb4-6044-45c8-a599-7733edad11ce tempest-VolumesTestJSON-2030235813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d97d6d7-2985-410a-841e-00acd86e376b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:07 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6858bdb4-6044-45c8-a599-7733edad11ce tempest-VolumesTestJSON-2030235813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d97d6d7-2985-410a-841e-00acd86e376b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '721c9792-a3a0-4dfa-9839-cfb5cbd43d94', 'volume_name': 'volume-721c9792-a3a0-4dfa-9839-cfb5cbd43d94', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:07 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6858bdb4-6044-45c8-a599-7733edad11ce tempest-VolumesTestJSON-2030235813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c493871-e266-46fc-a646-7d5315a3bba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:07 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6858bdb4-6044-45c8-a599-7733edad11ce tempest-VolumesTestJSON-2030235813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c493871-e266-46fc-a646-7d5315a3bba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:07 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6858bdb4-6044-45c8-a599-7733edad11ce tempest-VolumesTestJSON-2030235813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a9ac282-8c3e-4924-8904-1e3d5014a333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:07 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-6858bdb4-6044-45c8-a599-7733edad11ce tempest-VolumesTestJSON-2030235813 None] Volume 721c9792-a3a0-4dfa-9839-cfb5cbd43d94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-721c9792-a3a0-4dfa-9839-cfb5cbd43d94', 'volume_size': 1} Apr 24 13:52:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-6858bdb4-6044-45c8-a599-7733edad11ce tempest-VolumesTestJSON-2030235813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:52:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-6858bdb4-6044-45c8-a599-7733edad11ce tempest-VolumesTestJSON-2030235813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:52:07 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-6858bdb4-6044-45c8-a599-7733edad11ce tempest-VolumesTestJSON-2030235813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:52:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-660284287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=721c9792-a3a0-4dfa-9839-cfb5cbd43d94,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='01ed2757cd1046bca5320596edad5b61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:52:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:52:07Z,use_quota=True,user_id='c0138879011249afb7c1ed12220e1e1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:52:07 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-6858bdb4-6044-45c8-a599-7733edad11ce tempest-VolumesTestJSON-2030235813 None] Creating volume 721c9792-a3a0-4dfa-9839-cfb5cbd43d94 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:52:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-6858bdb4-6044-45c8-a599-7733edad11ce tempest-VolumesTestJSON-2030235813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:52:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-6858bdb4-6044-45c8-a599-7733edad11ce tempest-VolumesTestJSON-2030235813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:52:07 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-6858bdb4-6044-45c8-a599-7733edad11ce tempest-VolumesTestJSON-2030235813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:52:07 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-6858bdb4-6044-45c8-a599-7733edad11ce tempest-VolumesTestJSON-2030235813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:52:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-6858bdb4-6044-45c8-a599-7733edad11ce tempest-VolumesTestJSON-2030235813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:52:07 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-6858bdb4-6044-45c8-a599-7733edad11ce tempest-VolumesTestJSON-2030235813 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:52:07 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-6858bdb4-6044-45c8-a599-7733edad11ce tempest-VolumesTestJSON-2030235813 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:52:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6858bdb4-6044-45c8-a599-7733edad11ce tempest-VolumesTestJSON-2030235813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-721c9792-a3a0-4dfa-9839-cfb5cbd43d94 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:07 devstack sudo[88200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-721c9792-a3a0-4dfa-9839-cfb5cbd43d94 1073741824 Apr 24 13:52:07 devstack sudo[88200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:07 devstack sudo[88197]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-c0040a3f-d17a-43ad-83dc-99363a7ceba2 tempest-VolumesActionsTest-1194041985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.626s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:07 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-c0040a3f-d17a-43ad-83dc-99363a7ceba2 tempest-VolumesActionsTest-1194041985 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:52:07 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-c0040a3f-d17a-43ad-83dc-99363a7ceba2 tempest-VolumesActionsTest-1194041985 None] Deleted volume successfully. Apr 24 13:52:07 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-c0040a3f-d17a-43ad-83dc-99363a7ceba2 tempest-VolumesActionsTest-1194041985 None] Lock "cinder-9c88cc0b-6770-4aeb-97a9-5f99694b5dd7-delete_volume" released by "delete_volume" :: held 2.521s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:52:07 devstack sudo[88200]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6858bdb4-6044-45c8-a599-7733edad11ce tempest-VolumesTestJSON-2030235813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-721c9792-a3a0-4dfa-9839-cfb5cbd43d94 1073741824" returned: 0 in 0.668s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6858bdb4-6044-45c8-a599-7733edad11ce tempest-VolumesTestJSON-2030235813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-721c9792-a3a0-4dfa-9839-cfb5cbd43d94 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:08 devstack sudo[88205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-721c9792-a3a0-4dfa-9839-cfb5cbd43d94 Apr 24 13:52:08 devstack sudo[88205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:08 devstack sudo[88205]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6858bdb4-6044-45c8-a599-7733edad11ce tempest-VolumesTestJSON-2030235813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-721c9792-a3a0-4dfa-9839-cfb5cbd43d94" returned: 0 in 0.494s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:08 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-6858bdb4-6044-45c8-a599-7733edad11ce tempest-VolumesTestJSON-2030235813 None] <== create_volume: return (1533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:52:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-6858bdb4-6044-45c8-a599-7733edad11ce tempest-VolumesTestJSON-2030235813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.539s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:52:10 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6858bdb4-6044-45c8-a599-7733edad11ce tempest-VolumesTestJSON-2030235813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a9ac282-8c3e-4924-8904-1e3d5014a333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-721c9792-a3a0-4dfa-9839-cfb5cbd43d94', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:10 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6858bdb4-6044-45c8-a599-7733edad11ce tempest-VolumesTestJSON-2030235813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cb1ff4a-1d28-4de2-a335-9daf0b79e090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:11 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-6858bdb4-6044-45c8-a599-7733edad11ce tempest-VolumesTestJSON-2030235813 None] Volume volume-721c9792-a3a0-4dfa-9839-cfb5cbd43d94 (721c9792-a3a0-4dfa-9839-cfb5cbd43d94): created successfully Apr 24 13:52:11 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6858bdb4-6044-45c8-a599-7733edad11ce tempest-VolumesTestJSON-2030235813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cb1ff4a-1d28-4de2-a335-9daf0b79e090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:11 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6858bdb4-6044-45c8-a599-7733edad11ce tempest-VolumesTestJSON-2030235813 None] Flow 'volume_create_manager' (f1b5c459-2ff8-4874-8573-a1185d02957d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:52:11 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-6858bdb4-6044-45c8-a599-7733edad11ce tempest-VolumesTestJSON-2030235813 None] Created volume successfully. Apr 24 13:52:13 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-f59ed90c-a341-4b27-8958-dfbd91965ef4 tempest-VolumesTestJSON-2030235813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:52:13 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f59ed90c-a341-4b27-8958-dfbd91965ef4 tempest-VolumesTestJSON-2030235813 None] Flow 'volume_create_manager' (cdab68d5-1489-4683-ad0d-a7b753eb5db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:52:13 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f59ed90c-a341-4b27-8958-dfbd91965ef4 tempest-VolumesTestJSON-2030235813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c8190bf-0389-4d3d-809e-151369158e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:13 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f59ed90c-a341-4b27-8958-dfbd91965ef4 tempest-VolumesTestJSON-2030235813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c8190bf-0389-4d3d-809e-151369158e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1569281501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0552e8d1-04da-4e9a-948c-b15406fdbb0d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='01ed2757cd1046bca5320596edad5b61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:52:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:52:13Z,use_quota=True,user_id='c0138879011249afb7c1ed12220e1e1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:13 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f59ed90c-a341-4b27-8958-dfbd91965ef4 tempest-VolumesTestJSON-2030235813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0d086f1-c2d6-45cb-a714-ed91ac5bd66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:13 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f59ed90c-a341-4b27-8958-dfbd91965ef4 tempest-VolumesTestJSON-2030235813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0d086f1-c2d6-45cb-a714-ed91ac5bd66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:13 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f59ed90c-a341-4b27-8958-dfbd91965ef4 tempest-VolumesTestJSON-2030235813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9a90a00-44fa-4726-920f-dce8ba87f43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:13 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f59ed90c-a341-4b27-8958-dfbd91965ef4 tempest-VolumesTestJSON-2030235813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9a90a00-44fa-4726-920f-dce8ba87f43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0552e8d1-04da-4e9a-948c-b15406fdbb0d', 'volume_name': 'volume-0552e8d1-04da-4e9a-948c-b15406fdbb0d', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:13 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f59ed90c-a341-4b27-8958-dfbd91965ef4 tempest-VolumesTestJSON-2030235813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0de2f7bf-7679-4640-9227-79d647e9a090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:13 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f59ed90c-a341-4b27-8958-dfbd91965ef4 tempest-VolumesTestJSON-2030235813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0de2f7bf-7679-4640-9227-79d647e9a090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:13 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f59ed90c-a341-4b27-8958-dfbd91965ef4 tempest-VolumesTestJSON-2030235813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e2a8798-52a7-4e75-9dc2-f22dad599f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:13 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-f59ed90c-a341-4b27-8958-dfbd91965ef4 tempest-VolumesTestJSON-2030235813 None] Volume 0552e8d1-04da-4e9a-948c-b15406fdbb0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0552e8d1-04da-4e9a-948c-b15406fdbb0d', 'volume_size': 1} Apr 24 13:52:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f59ed90c-a341-4b27-8958-dfbd91965ef4 tempest-VolumesTestJSON-2030235813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:52:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f59ed90c-a341-4b27-8958-dfbd91965ef4 tempest-VolumesTestJSON-2030235813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:52:13 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-f59ed90c-a341-4b27-8958-dfbd91965ef4 tempest-VolumesTestJSON-2030235813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1569281501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0552e8d1-04da-4e9a-948c-b15406fdbb0d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='01ed2757cd1046bca5320596edad5b61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:52:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:52:13Z,use_quota=True,user_id='c0138879011249afb7c1ed12220e1e1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:52:13 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-f59ed90c-a341-4b27-8958-dfbd91965ef4 tempest-VolumesTestJSON-2030235813 None] Creating volume 0552e8d1-04da-4e9a-948c-b15406fdbb0d {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:52:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f59ed90c-a341-4b27-8958-dfbd91965ef4 tempest-VolumesTestJSON-2030235813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:52:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f59ed90c-a341-4b27-8958-dfbd91965ef4 tempest-VolumesTestJSON-2030235813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:52:13 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-f59ed90c-a341-4b27-8958-dfbd91965ef4 tempest-VolumesTestJSON-2030235813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:52:13 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-f59ed90c-a341-4b27-8958-dfbd91965ef4 tempest-VolumesTestJSON-2030235813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:52:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f59ed90c-a341-4b27-8958-dfbd91965ef4 tempest-VolumesTestJSON-2030235813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:52:13 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-f59ed90c-a341-4b27-8958-dfbd91965ef4 tempest-VolumesTestJSON-2030235813 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:52:13 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-f59ed90c-a341-4b27-8958-dfbd91965ef4 tempest-VolumesTestJSON-2030235813 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:52:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f59ed90c-a341-4b27-8958-dfbd91965ef4 tempest-VolumesTestJSON-2030235813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0552e8d1-04da-4e9a-948c-b15406fdbb0d 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:13 devstack sudo[88209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0552e8d1-04da-4e9a-948c-b15406fdbb0d 1073741824 Apr 24 13:52:13 devstack sudo[88209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:14 devstack sudo[88209]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f59ed90c-a341-4b27-8958-dfbd91965ef4 tempest-VolumesTestJSON-2030235813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0552e8d1-04da-4e9a-948c-b15406fdbb0d 1073741824" returned: 0 in 0.822s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f59ed90c-a341-4b27-8958-dfbd91965ef4 tempest-VolumesTestJSON-2030235813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0552e8d1-04da-4e9a-948c-b15406fdbb0d {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:14 devstack sudo[88214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0552e8d1-04da-4e9a-948c-b15406fdbb0d Apr 24 13:52:14 devstack sudo[88214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:14 devstack sudo[88214]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f59ed90c-a341-4b27-8958-dfbd91965ef4 tempest-VolumesTestJSON-2030235813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0552e8d1-04da-4e9a-948c-b15406fdbb0d" returned: 0 in 0.583s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:14 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-f59ed90c-a341-4b27-8958-dfbd91965ef4 tempest-VolumesTestJSON-2030235813 None] <== create_volume: return (1453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:52:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f59ed90c-a341-4b27-8958-dfbd91965ef4 tempest-VolumesTestJSON-2030235813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.456s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:52:14 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f59ed90c-a341-4b27-8958-dfbd91965ef4 tempest-VolumesTestJSON-2030235813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e2a8798-52a7-4e75-9dc2-f22dad599f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0552e8d1-04da-4e9a-948c-b15406fdbb0d', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:14 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f59ed90c-a341-4b27-8958-dfbd91965ef4 tempest-VolumesTestJSON-2030235813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50dd8a06-a8e3-462a-b35e-f826cb63b454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:14 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-f59ed90c-a341-4b27-8958-dfbd91965ef4 tempest-VolumesTestJSON-2030235813 None] Volume volume-0552e8d1-04da-4e9a-948c-b15406fdbb0d (0552e8d1-04da-4e9a-948c-b15406fdbb0d): created successfully Apr 24 13:52:14 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f59ed90c-a341-4b27-8958-dfbd91965ef4 tempest-VolumesTestJSON-2030235813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50dd8a06-a8e3-462a-b35e-f826cb63b454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:14 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f59ed90c-a341-4b27-8958-dfbd91965ef4 tempest-VolumesTestJSON-2030235813 None] Flow 'volume_create_manager' (cdab68d5-1489-4683-ad0d-a7b753eb5db1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:52:14 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-f59ed90c-a341-4b27-8958-dfbd91965ef4 tempest-VolumesTestJSON-2030235813 None] Created volume successfully. Apr 24 13:52:16 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d44acc49-ffe9-48b0-95d8-6cea86d14324 tempest-VolumesTestJSON-2030235813 None] Acquiring lock "cinder-0552e8d1-04da-4e9a-948c-b15406fdbb0d-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:52:16 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d44acc49-ffe9-48b0-95d8-6cea86d14324 tempest-VolumesTestJSON-2030235813 None] Lock "cinder-0552e8d1-04da-4e9a-948c-b15406fdbb0d-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:52:16 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d44acc49-ffe9-48b0-95d8-6cea86d14324 tempest-VolumesTestJSON-2030235813 None] Acquiring lock "cinder-quobyte-0552e8d1-04da-4e9a-948c-b15406fdbb0d" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:52:16 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d44acc49-ffe9-48b0-95d8-6cea86d14324 tempest-VolumesTestJSON-2030235813 None] Lock "cinder-quobyte-0552e8d1-04da-4e9a-948c-b15406fdbb0d" acquired by "delete_volume" :: waited 0.033s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:52:16 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab32235b-7e79-49a1-bf78-00f1823c45a5]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:52:16 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d44acc49-ffe9-48b0-95d8-6cea86d14324 tempest-VolumesTestJSON-2030235813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0552e8d1-04da-4e9a-948c-b15406fdbb0d {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:16 devstack sudo[88251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0552e8d1-04da-4e9a-948c-b15406fdbb0d Apr 24 13:52:16 devstack sudo[88251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:17 devstack sudo[88251]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d44acc49-ffe9-48b0-95d8-6cea86d14324 tempest-VolumesTestJSON-2030235813 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0552e8d1-04da-4e9a-948c-b15406fdbb0d" returned: 0 in 0.639s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d44acc49-ffe9-48b0-95d8-6cea86d14324 tempest-VolumesTestJSON-2030235813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0552e8d1-04da-4e9a-948c-b15406fdbb0d {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:17 devstack sudo[88258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0552e8d1-04da-4e9a-948c-b15406fdbb0d Apr 24 13:52:17 devstack sudo[88258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:17 devstack sudo[88258]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d44acc49-ffe9-48b0-95d8-6cea86d14324 tempest-VolumesTestJSON-2030235813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0552e8d1-04da-4e9a-948c-b15406fdbb0d" returned: 0 in 0.547s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:17 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d44acc49-ffe9-48b0-95d8-6cea86d14324 tempest-VolumesTestJSON-2030235813 None] Lock "cinder-quobyte-0552e8d1-04da-4e9a-948c-b15406fdbb0d" released by "delete_volume" :: held 1.243s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:52:17 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-d44acc49-ffe9-48b0-95d8-6cea86d14324 tempest-VolumesTestJSON-2030235813 None] Created reservations ['5f67f604-3d5a-4b81-9e5f-1836e329d9e3', '778db0a1-f6b4-40c6-8aa9-5c8486042a32', 'a3b7e039-1120-47e4-894b-67dc768e4a38', 'e554cadc-9d40-4875-960a-924e7aee0545'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:52:18 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d44acc49-ffe9-48b0-95d8-6cea86d14324 tempest-VolumesTestJSON-2030235813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:52:18 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d44acc49-ffe9-48b0-95d8-6cea86d14324 tempest-VolumesTestJSON-2030235813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:52:18 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-d44acc49-ffe9-48b0-95d8-6cea86d14324 tempest-VolumesTestJSON-2030235813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:52:18 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-d44acc49-ffe9-48b0-95d8-6cea86d14324 tempest-VolumesTestJSON-2030235813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:52:18 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d44acc49-ffe9-48b0-95d8-6cea86d14324 tempest-VolumesTestJSON-2030235813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:52:18 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d44acc49-ffe9-48b0-95d8-6cea86d14324 tempest-VolumesTestJSON-2030235813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:18 devstack sudo[88261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:52:18 devstack sudo[88261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:18 devstack sudo[88261]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:18 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d44acc49-ffe9-48b0-95d8-6cea86d14324 tempest-VolumesTestJSON-2030235813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.623s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:18 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-d44acc49-ffe9-48b0-95d8-6cea86d14324 tempest-VolumesTestJSON-2030235813 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:52:18 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-d44acc49-ffe9-48b0-95d8-6cea86d14324 tempest-VolumesTestJSON-2030235813 None] Deleted volume successfully. Apr 24 13:52:18 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d44acc49-ffe9-48b0-95d8-6cea86d14324 tempest-VolumesTestJSON-2030235813 None] Lock "cinder-0552e8d1-04da-4e9a-948c-b15406fdbb0d-delete_volume" released by "delete_volume" :: held 2.204s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:52:18 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-56f6fd90-0277-4b71-8eb3-a8b70b1449d8 tempest-VolumesTestJSON-2030235813 None] Acquiring lock "cinder-721c9792-a3a0-4dfa-9839-cfb5cbd43d94-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:52:18 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-56f6fd90-0277-4b71-8eb3-a8b70b1449d8 tempest-VolumesTestJSON-2030235813 None] Lock "cinder-721c9792-a3a0-4dfa-9839-cfb5cbd43d94-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:52:18 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-56f6fd90-0277-4b71-8eb3-a8b70b1449d8 tempest-VolumesTestJSON-2030235813 None] Acquiring lock "cinder-quobyte-721c9792-a3a0-4dfa-9839-cfb5cbd43d94" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:52:18 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-56f6fd90-0277-4b71-8eb3-a8b70b1449d8 tempest-VolumesTestJSON-2030235813 None] Lock "cinder-quobyte-721c9792-a3a0-4dfa-9839-cfb5cbd43d94" acquired by "delete_volume" :: waited 0.018s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:52:19 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc13a3d9-d605-4500-9c50-ac2330727d04]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:52:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-56f6fd90-0277-4b71-8eb3-a8b70b1449d8 tempest-VolumesTestJSON-2030235813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-721c9792-a3a0-4dfa-9839-cfb5cbd43d94 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:19 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-e036a7e6-c12e-4f12-954b-7fc5bbc82fe8 tempest-VolumesTransfersTest-147561863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:52:19 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e036a7e6-c12e-4f12-954b-7fc5bbc82fe8 tempest-VolumesTransfersTest-147561863 None] Flow 'volume_create_manager' (9145b105-4eda-4060-a826-28498a34ccdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:52:19 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e036a7e6-c12e-4f12-954b-7fc5bbc82fe8 tempest-VolumesTransfersTest-147561863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ac16bf0-4093-48ef-b4dd-f24fcf7267aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:19 devstack sudo[88264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-721c9792-a3a0-4dfa-9839-cfb5cbd43d94 Apr 24 13:52:19 devstack sudo[88264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:19 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e036a7e6-c12e-4f12-954b-7fc5bbc82fe8 tempest-VolumesTransfersTest-147561863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ac16bf0-4093-48ef-b4dd-f24fcf7267aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1156611285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8516b6f4-ec7f-48c1-a55d-8dbb090d3e8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adb67c6dabaf4062a106b8a21e906e8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:52:19Z,use_quota=True,user_id='330e9daf6716450481991c8241f48631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:19 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e036a7e6-c12e-4f12-954b-7fc5bbc82fe8 tempest-VolumesTransfersTest-147561863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f95422a8-b4f4-413f-b8b3-a7d5d55825a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:19 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e036a7e6-c12e-4f12-954b-7fc5bbc82fe8 tempest-VolumesTransfersTest-147561863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f95422a8-b4f4-413f-b8b3-a7d5d55825a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:19 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e036a7e6-c12e-4f12-954b-7fc5bbc82fe8 tempest-VolumesTransfersTest-147561863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (678fd3d7-f940-46a4-8a97-5f9de767d5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:19 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e036a7e6-c12e-4f12-954b-7fc5bbc82fe8 tempest-VolumesTransfersTest-147561863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (678fd3d7-f940-46a4-8a97-5f9de767d5c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8516b6f4-ec7f-48c1-a55d-8dbb090d3e8b', 'volume_name': 'volume-8516b6f4-ec7f-48c1-a55d-8dbb090d3e8b', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:19 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e036a7e6-c12e-4f12-954b-7fc5bbc82fe8 tempest-VolumesTransfersTest-147561863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5afcbdec-bfa9-4b4d-aaf5-dac6bf602aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:19 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e036a7e6-c12e-4f12-954b-7fc5bbc82fe8 tempest-VolumesTransfersTest-147561863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5afcbdec-bfa9-4b4d-aaf5-dac6bf602aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:19 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e036a7e6-c12e-4f12-954b-7fc5bbc82fe8 tempest-VolumesTransfersTest-147561863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a3a6a3e-2304-4cf6-b21a-913dd3ef20dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:19 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-e036a7e6-c12e-4f12-954b-7fc5bbc82fe8 tempest-VolumesTransfersTest-147561863 None] Volume 8516b6f4-ec7f-48c1-a55d-8dbb090d3e8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8516b6f4-ec7f-48c1-a55d-8dbb090d3e8b', 'volume_size': 1} Apr 24 13:52:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-e036a7e6-c12e-4f12-954b-7fc5bbc82fe8 tempest-VolumesTransfersTest-147561863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:52:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-e036a7e6-c12e-4f12-954b-7fc5bbc82fe8 tempest-VolumesTransfersTest-147561863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:52:19 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-e036a7e6-c12e-4f12-954b-7fc5bbc82fe8 tempest-VolumesTransfersTest-147561863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1156611285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8516b6f4-ec7f-48c1-a55d-8dbb090d3e8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adb67c6dabaf4062a106b8a21e906e8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:52:19Z,use_quota=True,user_id='330e9daf6716450481991c8241f48631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:52:19 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-e036a7e6-c12e-4f12-954b-7fc5bbc82fe8 tempest-VolumesTransfersTest-147561863 None] Creating volume 8516b6f4-ec7f-48c1-a55d-8dbb090d3e8b {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:52:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-e036a7e6-c12e-4f12-954b-7fc5bbc82fe8 tempest-VolumesTransfersTest-147561863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:52:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-e036a7e6-c12e-4f12-954b-7fc5bbc82fe8 tempest-VolumesTransfersTest-147561863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:52:19 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-e036a7e6-c12e-4f12-954b-7fc5bbc82fe8 tempest-VolumesTransfersTest-147561863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:52:19 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-e036a7e6-c12e-4f12-954b-7fc5bbc82fe8 tempest-VolumesTransfersTest-147561863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:52:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-e036a7e6-c12e-4f12-954b-7fc5bbc82fe8 tempest-VolumesTransfersTest-147561863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:52:19 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-e036a7e6-c12e-4f12-954b-7fc5bbc82fe8 tempest-VolumesTransfersTest-147561863 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:52:19 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-e036a7e6-c12e-4f12-954b-7fc5bbc82fe8 tempest-VolumesTransfersTest-147561863 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:52:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e036a7e6-c12e-4f12-954b-7fc5bbc82fe8 tempest-VolumesTransfersTest-147561863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-8516b6f4-ec7f-48c1-a55d-8dbb090d3e8b 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:19 devstack sudo[88266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-8516b6f4-ec7f-48c1-a55d-8dbb090d3e8b 1073741824 Apr 24 13:52:19 devstack sudo[88266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:19 devstack sudo[88264]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-56f6fd90-0277-4b71-8eb3-a8b70b1449d8 tempest-VolumesTestJSON-2030235813 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-721c9792-a3a0-4dfa-9839-cfb5cbd43d94" returned: 0 in 0.762s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-56f6fd90-0277-4b71-8eb3-a8b70b1449d8 tempest-VolumesTestJSON-2030235813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-721c9792-a3a0-4dfa-9839-cfb5cbd43d94 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:19 devstack sudo[88274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-721c9792-a3a0-4dfa-9839-cfb5cbd43d94 Apr 24 13:52:19 devstack sudo[88274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:19 devstack sudo[88266]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e036a7e6-c12e-4f12-954b-7fc5bbc82fe8 tempest-VolumesTransfersTest-147561863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-8516b6f4-ec7f-48c1-a55d-8dbb090d3e8b 1073741824" returned: 0 in 0.797s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e036a7e6-c12e-4f12-954b-7fc5bbc82fe8 tempest-VolumesTransfersTest-147561863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-8516b6f4-ec7f-48c1-a55d-8dbb090d3e8b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:20 devstack sudo[88276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-8516b6f4-ec7f-48c1-a55d-8dbb090d3e8b Apr 24 13:52:20 devstack sudo[88276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:20 devstack sudo[88274]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-56f6fd90-0277-4b71-8eb3-a8b70b1449d8 tempest-VolumesTestJSON-2030235813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-721c9792-a3a0-4dfa-9839-cfb5cbd43d94" returned: 0 in 0.619s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:20 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-56f6fd90-0277-4b71-8eb3-a8b70b1449d8 tempest-VolumesTestJSON-2030235813 None] Lock "cinder-quobyte-721c9792-a3a0-4dfa-9839-cfb5cbd43d94" released by "delete_volume" :: held 1.444s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:52:20 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-56f6fd90-0277-4b71-8eb3-a8b70b1449d8 tempest-VolumesTestJSON-2030235813 None] Created reservations ['97c51a6d-ef54-4347-b044-2d98ded00d31', 'f69095f1-209c-4cda-b551-1795b6c5b880', '2a31d6e1-7282-41f5-9c51-6160c0c202f9', '44e772e2-5aaa-4d31-9402-002421ae3ba1'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:52:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-56f6fd90-0277-4b71-8eb3-a8b70b1449d8 tempest-VolumesTestJSON-2030235813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:52:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-56f6fd90-0277-4b71-8eb3-a8b70b1449d8 tempest-VolumesTestJSON-2030235813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:52:20 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-56f6fd90-0277-4b71-8eb3-a8b70b1449d8 tempest-VolumesTestJSON-2030235813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:52:20 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-56f6fd90-0277-4b71-8eb3-a8b70b1449d8 tempest-VolumesTestJSON-2030235813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:52:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-56f6fd90-0277-4b71-8eb3-a8b70b1449d8 tempest-VolumesTestJSON-2030235813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:52:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-56f6fd90-0277-4b71-8eb3-a8b70b1449d8 tempest-VolumesTestJSON-2030235813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:20 devstack sudo[88280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:52:20 devstack sudo[88280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:20 devstack sudo[88276]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e036a7e6-c12e-4f12-954b-7fc5bbc82fe8 tempest-VolumesTransfersTest-147561863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-8516b6f4-ec7f-48c1-a55d-8dbb090d3e8b" returned: 0 in 0.601s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:20 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-e036a7e6-c12e-4f12-954b-7fc5bbc82fe8 tempest-VolumesTransfersTest-147561863 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:52:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-e036a7e6-c12e-4f12-954b-7fc5bbc82fe8 tempest-VolumesTransfersTest-147561863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:52:20 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e036a7e6-c12e-4f12-954b-7fc5bbc82fe8 tempest-VolumesTransfersTest-147561863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a3a6a3e-2304-4cf6-b21a-913dd3ef20dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8516b6f4-ec7f-48c1-a55d-8dbb090d3e8b', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:20 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e036a7e6-c12e-4f12-954b-7fc5bbc82fe8 tempest-VolumesTransfersTest-147561863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7687509-9e79-4a97-913d-3e4b05553129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:20 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-e036a7e6-c12e-4f12-954b-7fc5bbc82fe8 tempest-VolumesTransfersTest-147561863 None] Volume volume-8516b6f4-ec7f-48c1-a55d-8dbb090d3e8b (8516b6f4-ec7f-48c1-a55d-8dbb090d3e8b): created successfully Apr 24 13:52:20 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e036a7e6-c12e-4f12-954b-7fc5bbc82fe8 tempest-VolumesTransfersTest-147561863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7687509-9e79-4a97-913d-3e4b05553129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:20 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e036a7e6-c12e-4f12-954b-7fc5bbc82fe8 tempest-VolumesTransfersTest-147561863 None] Flow 'volume_create_manager' (9145b105-4eda-4060-a826-28498a34ccdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:52:20 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-e036a7e6-c12e-4f12-954b-7fc5bbc82fe8 tempest-VolumesTransfersTest-147561863 None] Created volume successfully. Apr 24 13:52:21 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ca6cfb4a-49c8-4bbc-86cd-50fe8e94eac2 tempest-VolumesTestJSON-2030235813 None] Acquiring lock "cinder-8d4be63e-48eb-4b47-bcc4-e736b51eff8d-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:52:21 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ca6cfb4a-49c8-4bbc-86cd-50fe8e94eac2 tempest-VolumesTestJSON-2030235813 None] Lock "cinder-8d4be63e-48eb-4b47-bcc4-e736b51eff8d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:52:21 devstack sudo[88280]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-56f6fd90-0277-4b71-8eb3-a8b70b1449d8 tempest-VolumesTestJSON-2030235813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.684s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:21 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-56f6fd90-0277-4b71-8eb3-a8b70b1449d8 tempest-VolumesTestJSON-2030235813 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:52:21 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-56f6fd90-0277-4b71-8eb3-a8b70b1449d8 tempest-VolumesTestJSON-2030235813 None] Deleted volume successfully. Apr 24 13:52:21 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ca6cfb4a-49c8-4bbc-86cd-50fe8e94eac2 tempest-VolumesTestJSON-2030235813 None] Acquiring lock "cinder-quobyte-8d4be63e-48eb-4b47-bcc4-e736b51eff8d" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:52:21 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-56f6fd90-0277-4b71-8eb3-a8b70b1449d8 tempest-VolumesTestJSON-2030235813 None] Lock "cinder-721c9792-a3a0-4dfa-9839-cfb5cbd43d94-delete_volume" released by "delete_volume" :: held 2.405s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:52:21 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ca6cfb4a-49c8-4bbc-86cd-50fe8e94eac2 tempest-VolumesTestJSON-2030235813 None] Lock "cinder-quobyte-8d4be63e-48eb-4b47-bcc4-e736b51eff8d" acquired by "delete_volume" :: waited 0.027s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:52:21 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[45abdb42-2594-46bb-91a6-2765ecedb957]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:52:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ca6cfb4a-49c8-4bbc-86cd-50fe8e94eac2 tempest-VolumesTestJSON-2030235813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-8d4be63e-48eb-4b47-bcc4-e736b51eff8d {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:21 devstack sudo[88283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-8d4be63e-48eb-4b47-bcc4-e736b51eff8d Apr 24 13:52:21 devstack sudo[88283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:22 devstack sudo[88283]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ca6cfb4a-49c8-4bbc-86cd-50fe8e94eac2 tempest-VolumesTestJSON-2030235813 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-8d4be63e-48eb-4b47-bcc4-e736b51eff8d" returned: 0 in 0.684s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ca6cfb4a-49c8-4bbc-86cd-50fe8e94eac2 tempest-VolumesTestJSON-2030235813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-8d4be63e-48eb-4b47-bcc4-e736b51eff8d {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:22 devstack sudo[88288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-8d4be63e-48eb-4b47-bcc4-e736b51eff8d Apr 24 13:52:22 devstack sudo[88288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:22 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-44ba85be-4c88-4a78-8398-35724c30924b tempest-VolumesTransfersTest-1285356019 None] Transfer volume completed successfully. Apr 24 13:52:22 devstack sudo[88288]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ca6cfb4a-49c8-4bbc-86cd-50fe8e94eac2 tempest-VolumesTestJSON-2030235813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-8d4be63e-48eb-4b47-bcc4-e736b51eff8d" returned: 0 in 0.535s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:22 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ca6cfb4a-49c8-4bbc-86cd-50fe8e94eac2 tempest-VolumesTestJSON-2030235813 None] Lock "cinder-quobyte-8d4be63e-48eb-4b47-bcc4-e736b51eff8d" released by "delete_volume" :: held 1.268s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:52:22 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-ca6cfb4a-49c8-4bbc-86cd-50fe8e94eac2 tempest-VolumesTestJSON-2030235813 None] Created reservations ['cf64effc-36b8-4daf-aa50-43dd08cba220', 'ce94407d-3c84-4efd-a4bd-17dd8a440135', '13d558be-e8f2-43fe-9a75-0ad7ee97d954', '7d3fa6aa-f5a3-4871-80c5-ea753d00155a'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:52:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-ca6cfb4a-49c8-4bbc-86cd-50fe8e94eac2 tempest-VolumesTestJSON-2030235813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:52:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-ca6cfb4a-49c8-4bbc-86cd-50fe8e94eac2 tempest-VolumesTestJSON-2030235813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:52:22 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-ca6cfb4a-49c8-4bbc-86cd-50fe8e94eac2 tempest-VolumesTestJSON-2030235813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:52:22 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-ca6cfb4a-49c8-4bbc-86cd-50fe8e94eac2 tempest-VolumesTestJSON-2030235813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:52:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-ca6cfb4a-49c8-4bbc-86cd-50fe8e94eac2 tempest-VolumesTestJSON-2030235813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:52:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ca6cfb4a-49c8-4bbc-86cd-50fe8e94eac2 tempest-VolumesTestJSON-2030235813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:22 devstack sudo[88291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:52:22 devstack sudo[88291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:23 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e798d5d3-5f37-4c73-8c03-efbd67192399 tempest-VolumesTransfersTest-1218854529 None] Acquiring lock "cinder-8516b6f4-ec7f-48c1-a55d-8dbb090d3e8b-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:52:23 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e798d5d3-5f37-4c73-8c03-efbd67192399 tempest-VolumesTransfersTest-1218854529 None] Lock "cinder-8516b6f4-ec7f-48c1-a55d-8dbb090d3e8b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:52:23 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e798d5d3-5f37-4c73-8c03-efbd67192399 tempest-VolumesTransfersTest-1218854529 None] Acquiring lock "cinder-quobyte-8516b6f4-ec7f-48c1-a55d-8dbb090d3e8b" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:52:23 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e798d5d3-5f37-4c73-8c03-efbd67192399 tempest-VolumesTransfersTest-1218854529 None] Lock "cinder-quobyte-8516b6f4-ec7f-48c1-a55d-8dbb090d3e8b" acquired by "delete_volume" :: waited 0.019s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:52:23 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[021473a6-c8ed-4241-a366-558f9b65f87e]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:52:23 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e798d5d3-5f37-4c73-8c03-efbd67192399 tempest-VolumesTransfersTest-1218854529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-8516b6f4-ec7f-48c1-a55d-8dbb090d3e8b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:23 devstack sudo[88293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-8516b6f4-ec7f-48c1-a55d-8dbb090d3e8b Apr 24 13:52:23 devstack sudo[88293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:23 devstack sudo[88291]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:23 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ca6cfb4a-49c8-4bbc-86cd-50fe8e94eac2 tempest-VolumesTestJSON-2030235813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.593s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:23 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-ca6cfb4a-49c8-4bbc-86cd-50fe8e94eac2 tempest-VolumesTestJSON-2030235813 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:52:23 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-ca6cfb4a-49c8-4bbc-86cd-50fe8e94eac2 tempest-VolumesTestJSON-2030235813 None] Deleted volume successfully. Apr 24 13:52:23 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ca6cfb4a-49c8-4bbc-86cd-50fe8e94eac2 tempest-VolumesTestJSON-2030235813 None] Lock "cinder-8d4be63e-48eb-4b47-bcc4-e736b51eff8d-delete_volume" released by "delete_volume" :: held 2.223s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:52:23 devstack sudo[88293]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:23 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e798d5d3-5f37-4c73-8c03-efbd67192399 tempest-VolumesTransfersTest-1218854529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-8516b6f4-ec7f-48c1-a55d-8dbb090d3e8b" returned: 0 in 0.765s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:23 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e798d5d3-5f37-4c73-8c03-efbd67192399 tempest-VolumesTransfersTest-1218854529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-8516b6f4-ec7f-48c1-a55d-8dbb090d3e8b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:23 devstack sudo[88299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-8516b6f4-ec7f-48c1-a55d-8dbb090d3e8b Apr 24 13:52:23 devstack sudo[88299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:24 devstack sudo[88299]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e798d5d3-5f37-4c73-8c03-efbd67192399 tempest-VolumesTransfersTest-1218854529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-8516b6f4-ec7f-48c1-a55d-8dbb090d3e8b" returned: 0 in 0.624s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:24 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e798d5d3-5f37-4c73-8c03-efbd67192399 tempest-VolumesTransfersTest-1218854529 None] Lock "cinder-quobyte-8516b6f4-ec7f-48c1-a55d-8dbb090d3e8b" released by "delete_volume" :: held 1.435s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:52:24 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-e798d5d3-5f37-4c73-8c03-efbd67192399 tempest-VolumesTransfersTest-1218854529 None] Created reservations ['3ea1088e-b804-4f49-b413-4da2ea62dffd', '76daa172-4b6a-433b-86a8-e41ef8fec8f8', 'b1b105cc-73e9-4134-8490-a60a119d5b30', '03321785-7164-4783-bd04-0b365aa1b9ba'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:52:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-e798d5d3-5f37-4c73-8c03-efbd67192399 tempest-VolumesTransfersTest-1218854529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:52:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-e798d5d3-5f37-4c73-8c03-efbd67192399 tempest-VolumesTransfersTest-1218854529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:52:24 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-e798d5d3-5f37-4c73-8c03-efbd67192399 tempest-VolumesTransfersTest-1218854529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:52:24 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-e798d5d3-5f37-4c73-8c03-efbd67192399 tempest-VolumesTransfersTest-1218854529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:52:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-e798d5d3-5f37-4c73-8c03-efbd67192399 tempest-VolumesTransfersTest-1218854529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:52:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e798d5d3-5f37-4c73-8c03-efbd67192399 tempest-VolumesTransfersTest-1218854529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:24 devstack sudo[88302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:52:24 devstack sudo[88302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:25 devstack sudo[88302]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:25 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e798d5d3-5f37-4c73-8c03-efbd67192399 tempest-VolumesTransfersTest-1218854529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.651s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:25 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-e798d5d3-5f37-4c73-8c03-efbd67192399 tempest-VolumesTransfersTest-1218854529 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:52:25 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-e798d5d3-5f37-4c73-8c03-efbd67192399 tempest-VolumesTransfersTest-1218854529 None] Deleted volume successfully. Apr 24 13:52:25 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e798d5d3-5f37-4c73-8c03-efbd67192399 tempest-VolumesTransfersTest-1218854529 None] Lock "cinder-8516b6f4-ec7f-48c1-a55d-8dbb090d3e8b-delete_volume" released by "delete_volume" :: held 2.342s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:52:25 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-61ad4c86-b4d7-47be-94bb-0b2880dd26d9 tempest-VolumesTransfersTest-147561863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:52:25 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-61ad4c86-b4d7-47be-94bb-0b2880dd26d9 tempest-VolumesTransfersTest-147561863 None] Flow 'volume_create_manager' (80e9aaa1-30a8-451d-adca-8b1f5312c15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:52:25 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-61ad4c86-b4d7-47be-94bb-0b2880dd26d9 tempest-VolumesTransfersTest-147561863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5bdbf88-01c4-4dda-8c66-4dbdd9943855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:25 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-61ad4c86-b4d7-47be-94bb-0b2880dd26d9 tempest-VolumesTransfersTest-147561863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5bdbf88-01c4-4dda-8c66-4dbdd9943855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-946328373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ac49b88-1b41-4eac-930c-2ef32f40afb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adb67c6dabaf4062a106b8a21e906e8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:52:26Z,use_quota=True,user_id='330e9daf6716450481991c8241f48631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:25 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-61ad4c86-b4d7-47be-94bb-0b2880dd26d9 tempest-VolumesTransfersTest-147561863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70b750fb-4bea-4d02-8e65-e95248bf7125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:25 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-61ad4c86-b4d7-47be-94bb-0b2880dd26d9 tempest-VolumesTransfersTest-147561863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70b750fb-4bea-4d02-8e65-e95248bf7125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:25 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-61ad4c86-b4d7-47be-94bb-0b2880dd26d9 tempest-VolumesTransfersTest-147561863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (955bf0df-1fc3-4dac-9c5b-0251d83b4afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:25 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-61ad4c86-b4d7-47be-94bb-0b2880dd26d9 tempest-VolumesTransfersTest-147561863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (955bf0df-1fc3-4dac-9c5b-0251d83b4afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ac49b88-1b41-4eac-930c-2ef32f40afb4', 'volume_name': 'volume-1ac49b88-1b41-4eac-930c-2ef32f40afb4', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:25 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-61ad4c86-b4d7-47be-94bb-0b2880dd26d9 tempest-VolumesTransfersTest-147561863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60e8a125-69d8-4645-83f5-caa0df0da25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:25 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-61ad4c86-b4d7-47be-94bb-0b2880dd26d9 tempest-VolumesTransfersTest-147561863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60e8a125-69d8-4645-83f5-caa0df0da25b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:25 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-61ad4c86-b4d7-47be-94bb-0b2880dd26d9 tempest-VolumesTransfersTest-147561863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41ca0d2a-5f28-475d-8df7-f2f4c4f0c6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:25 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-61ad4c86-b4d7-47be-94bb-0b2880dd26d9 tempest-VolumesTransfersTest-147561863 None] Volume 1ac49b88-1b41-4eac-930c-2ef32f40afb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ac49b88-1b41-4eac-930c-2ef32f40afb4', 'volume_size': 1} Apr 24 13:52:25 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-61ad4c86-b4d7-47be-94bb-0b2880dd26d9 tempest-VolumesTransfersTest-147561863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:52:25 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-61ad4c86-b4d7-47be-94bb-0b2880dd26d9 tempest-VolumesTransfersTest-147561863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:52:25 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-61ad4c86-b4d7-47be-94bb-0b2880dd26d9 tempest-VolumesTransfersTest-147561863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-946328373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ac49b88-1b41-4eac-930c-2ef32f40afb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adb67c6dabaf4062a106b8a21e906e8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:52:26Z,use_quota=True,user_id='330e9daf6716450481991c8241f48631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:52:25 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-61ad4c86-b4d7-47be-94bb-0b2880dd26d9 tempest-VolumesTransfersTest-147561863 None] Creating volume 1ac49b88-1b41-4eac-930c-2ef32f40afb4 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:52:25 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-61ad4c86-b4d7-47be-94bb-0b2880dd26d9 tempest-VolumesTransfersTest-147561863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:52:25 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-61ad4c86-b4d7-47be-94bb-0b2880dd26d9 tempest-VolumesTransfersTest-147561863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:52:25 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-61ad4c86-b4d7-47be-94bb-0b2880dd26d9 tempest-VolumesTransfersTest-147561863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:52:25 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-61ad4c86-b4d7-47be-94bb-0b2880dd26d9 tempest-VolumesTransfersTest-147561863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:52:25 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-61ad4c86-b4d7-47be-94bb-0b2880dd26d9 tempest-VolumesTransfersTest-147561863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:52:25 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-61ad4c86-b4d7-47be-94bb-0b2880dd26d9 tempest-VolumesTransfersTest-147561863 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:52:25 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-61ad4c86-b4d7-47be-94bb-0b2880dd26d9 tempest-VolumesTransfersTest-147561863 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:52:25 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-61ad4c86-b4d7-47be-94bb-0b2880dd26d9 tempest-VolumesTransfersTest-147561863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1ac49b88-1b41-4eac-930c-2ef32f40afb4 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:26 devstack sudo[88306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1ac49b88-1b41-4eac-930c-2ef32f40afb4 1073741824 Apr 24 13:52:26 devstack sudo[88306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:26 devstack sudo[88306]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-61ad4c86-b4d7-47be-94bb-0b2880dd26d9 tempest-VolumesTransfersTest-147561863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1ac49b88-1b41-4eac-930c-2ef32f40afb4 1073741824" returned: 0 in 0.938s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-61ad4c86-b4d7-47be-94bb-0b2880dd26d9 tempest-VolumesTransfersTest-147561863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1ac49b88-1b41-4eac-930c-2ef32f40afb4 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:27 devstack sudo[88311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1ac49b88-1b41-4eac-930c-2ef32f40afb4 Apr 24 13:52:27 devstack sudo[88311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:27 devstack sudo[88311]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:27 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-61ad4c86-b4d7-47be-94bb-0b2880dd26d9 tempest-VolumesTransfersTest-147561863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1ac49b88-1b41-4eac-930c-2ef32f40afb4" returned: 0 in 0.780s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:27 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-61ad4c86-b4d7-47be-94bb-0b2880dd26d9 tempest-VolumesTransfersTest-147561863 None] <== create_volume: return (1776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:52:27 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-61ad4c86-b4d7-47be-94bb-0b2880dd26d9 tempest-VolumesTransfersTest-147561863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.778s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:52:27 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-61ad4c86-b4d7-47be-94bb-0b2880dd26d9 tempest-VolumesTransfersTest-147561863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41ca0d2a-5f28-475d-8df7-f2f4c4f0c6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ac49b88-1b41-4eac-930c-2ef32f40afb4', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:27 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-61ad4c86-b4d7-47be-94bb-0b2880dd26d9 tempest-VolumesTransfersTest-147561863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de2139eb-01f1-46e7-a6e6-7be2c6baf2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:27 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-61ad4c86-b4d7-47be-94bb-0b2880dd26d9 tempest-VolumesTransfersTest-147561863 None] Volume volume-1ac49b88-1b41-4eac-930c-2ef32f40afb4 (1ac49b88-1b41-4eac-930c-2ef32f40afb4): created successfully Apr 24 13:52:27 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-61ad4c86-b4d7-47be-94bb-0b2880dd26d9 tempest-VolumesTransfersTest-147561863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de2139eb-01f1-46e7-a6e6-7be2c6baf2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:27 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-61ad4c86-b4d7-47be-94bb-0b2880dd26d9 tempest-VolumesTransfersTest-147561863 None] Flow 'volume_create_manager' (80e9aaa1-30a8-451d-adca-8b1f5312c15f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:52:27 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-61ad4c86-b4d7-47be-94bb-0b2880dd26d9 tempest-VolumesTransfersTest-147561863 None] Created volume successfully. Apr 24 13:52:28 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-bc404446-2e3a-46fe-8522-8a769d646266 tempest-VolumesTransfersTest-1218854529 None] Acquiring lock "cinder-1ac49b88-1b41-4eac-930c-2ef32f40afb4-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:52:28 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-bc404446-2e3a-46fe-8522-8a769d646266 tempest-VolumesTransfersTest-1218854529 None] Lock "cinder-1ac49b88-1b41-4eac-930c-2ef32f40afb4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:52:28 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-bc404446-2e3a-46fe-8522-8a769d646266 tempest-VolumesTransfersTest-1218854529 None] Acquiring lock "cinder-quobyte-1ac49b88-1b41-4eac-930c-2ef32f40afb4" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:52:28 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-bc404446-2e3a-46fe-8522-8a769d646266 tempest-VolumesTransfersTest-1218854529 None] Lock "cinder-quobyte-1ac49b88-1b41-4eac-930c-2ef32f40afb4" acquired by "delete_volume" :: waited 0.016s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:52:28 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b28621-520a-4b1d-ac87-ba98205ece96]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:52:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bc404446-2e3a-46fe-8522-8a769d646266 tempest-VolumesTransfersTest-1218854529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1ac49b88-1b41-4eac-930c-2ef32f40afb4 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:28 devstack sudo[88314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1ac49b88-1b41-4eac-930c-2ef32f40afb4 Apr 24 13:52:28 devstack sudo[88314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:28 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-80038706-1522-4542-8814-4ed6240b358f tempest-SnapshotsActionsTest-323206228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:52:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-80038706-1522-4542-8814-4ed6240b358f tempest-SnapshotsActionsTest-323206228 None] Flow 'volume_create_manager' (b65e12dc-b9e2-441f-ad4d-0139dabd26a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:52:29 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-80038706-1522-4542-8814-4ed6240b358f tempest-SnapshotsActionsTest-323206228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52a81764-6672-45e3-a9e0-18a266ffe03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:29 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-80038706-1522-4542-8814-4ed6240b358f tempest-SnapshotsActionsTest-323206228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52a81764-6672-45e3-a9e0-18a266ffe03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:52:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-5984057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44a6110a-61e2-4992-af85-a51911520efd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d289217d2b6445d49127a4016918d618',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:52:29Z,use_quota=True,user_id='dca9e898745449e8b6c40a324eea3131',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:29 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-80038706-1522-4542-8814-4ed6240b358f tempest-SnapshotsActionsTest-323206228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c26f8920-ede6-4187-ae86-52eea3a5ab77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:29 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-80038706-1522-4542-8814-4ed6240b358f tempest-SnapshotsActionsTest-323206228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c26f8920-ede6-4187-ae86-52eea3a5ab77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:29 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-80038706-1522-4542-8814-4ed6240b358f tempest-SnapshotsActionsTest-323206228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcac7f61-eae9-4a10-bde0-c049ddfe84a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:29 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-80038706-1522-4542-8814-4ed6240b358f tempest-SnapshotsActionsTest-323206228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcac7f61-eae9-4a10-bde0-c049ddfe84a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44a6110a-61e2-4992-af85-a51911520efd', 'volume_name': 'volume-44a6110a-61e2-4992-af85-a51911520efd', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:29 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-80038706-1522-4542-8814-4ed6240b358f tempest-SnapshotsActionsTest-323206228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (008d3161-3127-4c1e-9f1d-96a49cb7e182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:29 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-80038706-1522-4542-8814-4ed6240b358f tempest-SnapshotsActionsTest-323206228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (008d3161-3127-4c1e-9f1d-96a49cb7e182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:29 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-80038706-1522-4542-8814-4ed6240b358f tempest-SnapshotsActionsTest-323206228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6667dbd-e0b1-4a86-8c36-98c640582213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:29 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-80038706-1522-4542-8814-4ed6240b358f tempest-SnapshotsActionsTest-323206228 None] Volume 44a6110a-61e2-4992-af85-a51911520efd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44a6110a-61e2-4992-af85-a51911520efd', 'volume_size': 1} Apr 24 13:52:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-80038706-1522-4542-8814-4ed6240b358f tempest-SnapshotsActionsTest-323206228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:52:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-80038706-1522-4542-8814-4ed6240b358f tempest-SnapshotsActionsTest-323206228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:52:29 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-80038706-1522-4542-8814-4ed6240b358f tempest-SnapshotsActionsTest-323206228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:52:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-5984057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44a6110a-61e2-4992-af85-a51911520efd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d289217d2b6445d49127a4016918d618',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:52:29Z,use_quota=True,user_id='dca9e898745449e8b6c40a324eea3131',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:52:29 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-80038706-1522-4542-8814-4ed6240b358f tempest-SnapshotsActionsTest-323206228 None] Creating volume 44a6110a-61e2-4992-af85-a51911520efd {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:52:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-80038706-1522-4542-8814-4ed6240b358f tempest-SnapshotsActionsTest-323206228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:52:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-80038706-1522-4542-8814-4ed6240b358f tempest-SnapshotsActionsTest-323206228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:52:29 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-80038706-1522-4542-8814-4ed6240b358f tempest-SnapshotsActionsTest-323206228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:52:29 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-80038706-1522-4542-8814-4ed6240b358f tempest-SnapshotsActionsTest-323206228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:52:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-80038706-1522-4542-8814-4ed6240b358f tempest-SnapshotsActionsTest-323206228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:52:29 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-80038706-1522-4542-8814-4ed6240b358f tempest-SnapshotsActionsTest-323206228 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:52:29 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-80038706-1522-4542-8814-4ed6240b358f tempest-SnapshotsActionsTest-323206228 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:52:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-80038706-1522-4542-8814-4ed6240b358f tempest-SnapshotsActionsTest-323206228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:29 devstack sudo[88316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd 1073741824 Apr 24 13:52:29 devstack sudo[88316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:29 devstack sudo[88314]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bc404446-2e3a-46fe-8522-8a769d646266 tempest-VolumesTransfersTest-1218854529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1ac49b88-1b41-4eac-930c-2ef32f40afb4" returned: 0 in 0.627s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bc404446-2e3a-46fe-8522-8a769d646266 tempest-VolumesTransfersTest-1218854529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1ac49b88-1b41-4eac-930c-2ef32f40afb4 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:29 devstack sudo[88321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1ac49b88-1b41-4eac-930c-2ef32f40afb4 Apr 24 13:52:29 devstack sudo[88321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:29 devstack sudo[88316]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-80038706-1522-4542-8814-4ed6240b358f tempest-SnapshotsActionsTest-323206228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd 1073741824" returned: 0 in 0.738s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:29 devstack sudo[88321]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bc404446-2e3a-46fe-8522-8a769d646266 tempest-VolumesTransfersTest-1218854529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1ac49b88-1b41-4eac-930c-2ef32f40afb4" returned: 0 in 0.612s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:29 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-bc404446-2e3a-46fe-8522-8a769d646266 tempest-VolumesTransfersTest-1218854529 None] Lock "cinder-quobyte-1ac49b88-1b41-4eac-930c-2ef32f40afb4" released by "delete_volume" :: held 1.287s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:52:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-80038706-1522-4542-8814-4ed6240b358f tempest-SnapshotsActionsTest-323206228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:29 devstack sudo[88327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd Apr 24 13:52:29 devstack sudo[88327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:29 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-bc404446-2e3a-46fe-8522-8a769d646266 tempest-VolumesTransfersTest-1218854529 None] Created reservations ['0a6ddd04-a59f-4f81-921c-5c6cf54b87cb', '507fec52-853b-4153-be51-87a1742d3d79', '731630df-f63e-4570-aa3b-9953ce1d339f', '728ea27c-3122-4705-966b-a85843e89c4d'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:52:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-bc404446-2e3a-46fe-8522-8a769d646266 tempest-VolumesTransfersTest-1218854529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:52:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-bc404446-2e3a-46fe-8522-8a769d646266 tempest-VolumesTransfersTest-1218854529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:52:30 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-bc404446-2e3a-46fe-8522-8a769d646266 tempest-VolumesTransfersTest-1218854529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:52:30 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-bc404446-2e3a-46fe-8522-8a769d646266 tempest-VolumesTransfersTest-1218854529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:52:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-bc404446-2e3a-46fe-8522-8a769d646266 tempest-VolumesTransfersTest-1218854529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:52:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bc404446-2e3a-46fe-8522-8a769d646266 tempest-VolumesTransfersTest-1218854529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:30 devstack sudo[88329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:52:30 devstack sudo[88329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:30 devstack sudo[88327]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-80038706-1522-4542-8814-4ed6240b358f tempest-SnapshotsActionsTest-323206228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd" returned: 0 in 0.540s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:30 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-80038706-1522-4542-8814-4ed6240b358f tempest-SnapshotsActionsTest-323206228 None] <== create_volume: return (1345ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:52:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-80038706-1522-4542-8814-4ed6240b358f tempest-SnapshotsActionsTest-323206228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.348s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:52:30 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-80038706-1522-4542-8814-4ed6240b358f tempest-SnapshotsActionsTest-323206228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6667dbd-e0b1-4a86-8c36-98c640582213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44a6110a-61e2-4992-af85-a51911520efd', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:30 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-80038706-1522-4542-8814-4ed6240b358f tempest-SnapshotsActionsTest-323206228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca097fd-6865-4c16-8203-5e7a5dda475d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:30 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-80038706-1522-4542-8814-4ed6240b358f tempest-SnapshotsActionsTest-323206228 None] Volume volume-44a6110a-61e2-4992-af85-a51911520efd (44a6110a-61e2-4992-af85-a51911520efd): created successfully Apr 24 13:52:30 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-80038706-1522-4542-8814-4ed6240b358f tempest-SnapshotsActionsTest-323206228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca097fd-6865-4c16-8203-5e7a5dda475d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:30 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-80038706-1522-4542-8814-4ed6240b358f tempest-SnapshotsActionsTest-323206228 None] Flow 'volume_create_manager' (b65e12dc-b9e2-441f-ad4d-0139dabd26a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:52:30 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-80038706-1522-4542-8814-4ed6240b358f tempest-SnapshotsActionsTest-323206228 None] Created volume successfully. Apr 24 13:52:30 devstack sudo[88329]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bc404446-2e3a-46fe-8522-8a769d646266 tempest-VolumesTransfersTest-1218854529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.545s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:30 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-bc404446-2e3a-46fe-8522-8a769d646266 tempest-VolumesTransfersTest-1218854529 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:52:30 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-bc404446-2e3a-46fe-8522-8a769d646266 tempest-VolumesTransfersTest-1218854529 None] Deleted volume successfully. Apr 24 13:52:30 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-bc404446-2e3a-46fe-8522-8a769d646266 tempest-VolumesTransfersTest-1218854529 None] Lock "cinder-1ac49b88-1b41-4eac-930c-2ef32f40afb4-delete_volume" released by "delete_volume" :: held 2.145s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:52:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5beb1719-b927-4a80-89b2-1c0393a88510 tempest-SnapshotsActionsTest-323206228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:52:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5beb1719-b927-4a80-89b2-1c0393a88510 tempest-SnapshotsActionsTest-323206228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:52:31 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-5beb1719-b927-4a80-89b2-1c0393a88510 tempest-SnapshotsActionsTest-323206228 None] Creating offline snapshot 7907e6f2-be97-4c34-85be-eaa5fc99686e of volume 44a6110a-61e2-4992-af85-a51911520efd {{(pid=82046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 13:52:31 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[5239c71a-92f5-4b92-96f1-9bd6ed25184c]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:52:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5beb1719-b927-4a80-89b2-1c0393a88510 tempest-SnapshotsActionsTest-323206228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:31 devstack sudo[88333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd Apr 24 13:52:31 devstack sudo[88333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:32 devstack sudo[88333]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5beb1719-b927-4a80-89b2-1c0393a88510 tempest-SnapshotsActionsTest-323206228 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd" returned: 0 in 0.621s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5beb1719-b927-4a80-89b2-1c0393a88510 tempest-SnapshotsActionsTest-323206228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e 1G {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:32 devstack sudo[88338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e 1G Apr 24 13:52:32 devstack sudo[88338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:32 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f355e43-507d-4017-9f63-3037d5339825 tempest-VolumesSnapshotTestJSON-952003017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:52:32 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6f355e43-507d-4017-9f63-3037d5339825 tempest-VolumesSnapshotTestJSON-952003017 None] Flow 'volume_create_manager' (41e34cbb-7225-4d0d-ae69-5d5858857344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:52:32 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6f355e43-507d-4017-9f63-3037d5339825 tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfbc7b24-d2f3-4b54-82f2-d00bd425050d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:32 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6f355e43-507d-4017-9f63-3037d5339825 tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfbc7b24-d2f3-4b54-82f2-d00bd425050d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:52:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-584836692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78f402c7-4a8d-428f-ac00-20d12c72157d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81778cce064e41cca9db08dd8c34436d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:52:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:52:32Z,use_quota=True,user_id='828592763a7247db9e1ebd1796caa21e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:32 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6f355e43-507d-4017-9f63-3037d5339825 tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cce68c9-889e-4067-993c-f9ac55146017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:32 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6f355e43-507d-4017-9f63-3037d5339825 tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cce68c9-889e-4067-993c-f9ac55146017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:32 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6f355e43-507d-4017-9f63-3037d5339825 tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9559aec-eff6-4636-9b41-7aacfd2b4e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:32 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6f355e43-507d-4017-9f63-3037d5339825 tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9559aec-eff6-4636-9b41-7aacfd2b4e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78f402c7-4a8d-428f-ac00-20d12c72157d', 'volume_name': 'volume-78f402c7-4a8d-428f-ac00-20d12c72157d', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:32 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6f355e43-507d-4017-9f63-3037d5339825 tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86612d90-e3ff-479c-b39a-cd4c6f124626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:32 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6f355e43-507d-4017-9f63-3037d5339825 tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86612d90-e3ff-479c-b39a-cd4c6f124626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:32 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6f355e43-507d-4017-9f63-3037d5339825 tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c337104a-26fc-413f-a92e-d72b828de33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:32 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-6f355e43-507d-4017-9f63-3037d5339825 tempest-VolumesSnapshotTestJSON-952003017 None] Volume 78f402c7-4a8d-428f-ac00-20d12c72157d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78f402c7-4a8d-428f-ac00-20d12c72157d', 'volume_size': 1} Apr 24 13:52:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-6f355e43-507d-4017-9f63-3037d5339825 tempest-VolumesSnapshotTestJSON-952003017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:52:32 devstack sudo[88338]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5beb1719-b927-4a80-89b2-1c0393a88510 tempest-SnapshotsActionsTest-323206228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e 1G" returned: 0 in 0.914s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5beb1719-b927-4a80-89b2-1c0393a88510 tempest-SnapshotsActionsTest-323206228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44a6110a-61e2-4992-af85-a51911520efd -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:33 devstack sudo[88345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44a6110a-61e2-4992-af85-a51911520efd -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e Apr 24 13:52:33 devstack sudo[88345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:33 devstack sudo[88345]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5beb1719-b927-4a80-89b2-1c0393a88510 tempest-SnapshotsActionsTest-323206228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44a6110a-61e2-4992-af85-a51911520efd -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e" returned: 0 in 0.664s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:33 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-5beb1719-b927-4a80-89b2-1c0393a88510 tempest-SnapshotsActionsTest-323206228 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e is being set with open permissions: ugo+rw Apr 24 13:52:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5beb1719-b927-4a80-89b2-1c0393a88510 tempest-SnapshotsActionsTest-323206228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:33 devstack sudo[88350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e Apr 24 13:52:33 devstack sudo[88350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:34 devstack sudo[88350]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5beb1719-b927-4a80-89b2-1c0393a88510 tempest-SnapshotsActionsTest-323206228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e" returned: 0 in 0.638s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5beb1719-b927-4a80-89b2-1c0393a88510 tempest-SnapshotsActionsTest-323206228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:34 devstack sudo[88353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.info Apr 24 13:52:34 devstack sudo[88353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:34 devstack sudo[88353]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5beb1719-b927-4a80-89b2-1c0393a88510 tempest-SnapshotsActionsTest-323206228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.info" returned: 0 in 0.596s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:34 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-5beb1719-b927-4a80-89b2-1c0393a88510 tempest-SnapshotsActionsTest-323206228 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.info is being set with open permissions: ugo+rw Apr 24 13:52:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5beb1719-b927-4a80-89b2-1c0393a88510 tempest-SnapshotsActionsTest-323206228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:34 devstack sudo[88356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.info Apr 24 13:52:34 devstack sudo[88356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:35 devstack sudo[88356]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5beb1719-b927-4a80-89b2-1c0393a88510 tempest-SnapshotsActionsTest-323206228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.info" returned: 0 in 0.541s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5beb1719-b927-4a80-89b2-1c0393a88510 tempest-SnapshotsActionsTest-323206228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.106s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:52:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-6f355e43-507d-4017-9f63-3037d5339825 tempest-VolumesSnapshotTestJSON-952003017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.010s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:52:35 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-6f355e43-507d-4017-9f63-3037d5339825 tempest-VolumesSnapshotTestJSON-952003017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:52:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-584836692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78f402c7-4a8d-428f-ac00-20d12c72157d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81778cce064e41cca9db08dd8c34436d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:52:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:52:32Z,use_quota=True,user_id='828592763a7247db9e1ebd1796caa21e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:52:35 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-6f355e43-507d-4017-9f63-3037d5339825 tempest-VolumesSnapshotTestJSON-952003017 None] Creating volume 78f402c7-4a8d-428f-ac00-20d12c72157d {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:52:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-6f355e43-507d-4017-9f63-3037d5339825 tempest-VolumesSnapshotTestJSON-952003017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:52:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-6f355e43-507d-4017-9f63-3037d5339825 tempest-VolumesSnapshotTestJSON-952003017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:52:35 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-6f355e43-507d-4017-9f63-3037d5339825 tempest-VolumesSnapshotTestJSON-952003017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:52:35 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-6f355e43-507d-4017-9f63-3037d5339825 tempest-VolumesSnapshotTestJSON-952003017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:52:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-6f355e43-507d-4017-9f63-3037d5339825 tempest-VolumesSnapshotTestJSON-952003017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:52:35 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-6f355e43-507d-4017-9f63-3037d5339825 tempest-VolumesSnapshotTestJSON-952003017 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:52:35 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-6f355e43-507d-4017-9f63-3037d5339825 tempest-VolumesSnapshotTestJSON-952003017 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:52:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6f355e43-507d-4017-9f63-3037d5339825 tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-78f402c7-4a8d-428f-ac00-20d12c72157d 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:35 devstack sudo[88360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-78f402c7-4a8d-428f-ac00-20d12c72157d 1073741824 Apr 24 13:52:35 devstack sudo[88360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:35 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-5beb1719-b927-4a80-89b2-1c0393a88510 tempest-SnapshotsActionsTest-323206228 None] Create snapshot completed successfully Apr 24 13:52:36 devstack sudo[88360]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6f355e43-507d-4017-9f63-3037d5339825 tempest-VolumesSnapshotTestJSON-952003017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-78f402c7-4a8d-428f-ac00-20d12c72157d 1073741824" returned: 0 in 0.802s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6f355e43-507d-4017-9f63-3037d5339825 tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-78f402c7-4a8d-428f-ac00-20d12c72157d {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:36 devstack sudo[88365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-78f402c7-4a8d-428f-ac00-20d12c72157d Apr 24 13:52:36 devstack sudo[88365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:36 devstack sudo[88365]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6f355e43-507d-4017-9f63-3037d5339825 tempest-VolumesSnapshotTestJSON-952003017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-78f402c7-4a8d-428f-ac00-20d12c72157d" returned: 0 in 0.617s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:36 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-6f355e43-507d-4017-9f63-3037d5339825 tempest-VolumesSnapshotTestJSON-952003017 None] <== create_volume: return (1465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:52:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-6f355e43-507d-4017-9f63-3037d5339825 tempest-VolumesSnapshotTestJSON-952003017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.470s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:52:37 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6f355e43-507d-4017-9f63-3037d5339825 tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c337104a-26fc-413f-a92e-d72b828de33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78f402c7-4a8d-428f-ac00-20d12c72157d', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:37 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6f355e43-507d-4017-9f63-3037d5339825 tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fe70568-f22b-4892-8a4c-a161647316a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:37 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-6f355e43-507d-4017-9f63-3037d5339825 tempest-VolumesSnapshotTestJSON-952003017 None] Volume volume-78f402c7-4a8d-428f-ac00-20d12c72157d (78f402c7-4a8d-428f-ac00-20d12c72157d): created successfully Apr 24 13:52:37 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6f355e43-507d-4017-9f63-3037d5339825 tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fe70568-f22b-4892-8a4c-a161647316a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:37 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6f355e43-507d-4017-9f63-3037d5339825 tempest-VolumesSnapshotTestJSON-952003017 None] Flow 'volume_create_manager' (41e34cbb-7225-4d0d-ae69-5d5858857344) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:52:37 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-6f355e43-507d-4017-9f63-3037d5339825 tempest-VolumesSnapshotTestJSON-952003017 None] Created volume successfully. Apr 24 13:52:37 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7426233-86ef-4714-9b29-91c421f5a79e tempest-VolumesCloneTest-953879006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:52:37 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a7426233-86ef-4714-9b29-91c421f5a79e tempest-VolumesCloneTest-953879006 None] Flow 'volume_create_manager' (18455706-cc06-4b9c-b5de-7b6425358d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:52:37 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a7426233-86ef-4714-9b29-91c421f5a79e tempest-VolumesCloneTest-953879006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbafa3b5-d03e-4781-a040-f5f7c21aaf9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:37 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a7426233-86ef-4714-9b29-91c421f5a79e tempest-VolumesCloneTest-953879006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbafa3b5-d03e-4781-a040-f5f7c21aaf9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1651489083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cd0e687-792a-4a73-9c15-8084ecfc186c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba486509ab39440fab66ba47d49fc277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:52:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:52:37Z,use_quota=True,user_id='5e1cdd797b4c46848280a0ad16539136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:37 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a7426233-86ef-4714-9b29-91c421f5a79e tempest-VolumesCloneTest-953879006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5066c5e8-ffe7-409b-9cac-1ac8aa4b3ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:37 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a7426233-86ef-4714-9b29-91c421f5a79e tempest-VolumesCloneTest-953879006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5066c5e8-ffe7-409b-9cac-1ac8aa4b3ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:37 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a7426233-86ef-4714-9b29-91c421f5a79e tempest-VolumesCloneTest-953879006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c27e9447-cefd-4098-a202-525a2fdd9a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:37 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a7426233-86ef-4714-9b29-91c421f5a79e tempest-VolumesCloneTest-953879006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c27e9447-cefd-4098-a202-525a2fdd9a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cd0e687-792a-4a73-9c15-8084ecfc186c', 'volume_name': 'volume-4cd0e687-792a-4a73-9c15-8084ecfc186c', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:37 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a7426233-86ef-4714-9b29-91c421f5a79e tempest-VolumesCloneTest-953879006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e0eba17-8fc8-4ed6-a638-5ddb4fb0beba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:37 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a7426233-86ef-4714-9b29-91c421f5a79e tempest-VolumesCloneTest-953879006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e0eba17-8fc8-4ed6-a638-5ddb4fb0beba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:37 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a7426233-86ef-4714-9b29-91c421f5a79e tempest-VolumesCloneTest-953879006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b0d3611-ffe4-442c-a06b-15c54c32eec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:37 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-a7426233-86ef-4714-9b29-91c421f5a79e tempest-VolumesCloneTest-953879006 None] Volume 4cd0e687-792a-4a73-9c15-8084ecfc186c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cd0e687-792a-4a73-9c15-8084ecfc186c', 'volume_size': 1} Apr 24 13:52:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a7426233-86ef-4714-9b29-91c421f5a79e tempest-VolumesCloneTest-953879006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:52:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a7426233-86ef-4714-9b29-91c421f5a79e tempest-VolumesCloneTest-953879006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:52:37 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a7426233-86ef-4714-9b29-91c421f5a79e tempest-VolumesCloneTest-953879006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1651489083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cd0e687-792a-4a73-9c15-8084ecfc186c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba486509ab39440fab66ba47d49fc277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:52:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:52:37Z,use_quota=True,user_id='5e1cdd797b4c46848280a0ad16539136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:52:37 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-a7426233-86ef-4714-9b29-91c421f5a79e tempest-VolumesCloneTest-953879006 None] Creating volume 4cd0e687-792a-4a73-9c15-8084ecfc186c {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:52:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a7426233-86ef-4714-9b29-91c421f5a79e tempest-VolumesCloneTest-953879006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:52:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a7426233-86ef-4714-9b29-91c421f5a79e tempest-VolumesCloneTest-953879006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:52:37 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a7426233-86ef-4714-9b29-91c421f5a79e tempest-VolumesCloneTest-953879006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:52:37 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a7426233-86ef-4714-9b29-91c421f5a79e tempest-VolumesCloneTest-953879006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:52:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a7426233-86ef-4714-9b29-91c421f5a79e tempest-VolumesCloneTest-953879006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:52:37 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a7426233-86ef-4714-9b29-91c421f5a79e tempest-VolumesCloneTest-953879006 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:52:37 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-a7426233-86ef-4714-9b29-91c421f5a79e tempest-VolumesCloneTest-953879006 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:52:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a7426233-86ef-4714-9b29-91c421f5a79e tempest-VolumesCloneTest-953879006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:37 devstack sudo[88368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c 1073741824 Apr 24 13:52:37 devstack sudo[88368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0e7176ae-82a6-474a-a3c0-66e9d9696ca6 tempest-SnapshotsActionsTest-323206228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:52:37 devstack cinder-volume[82046]: DEBUG oslo_service.periodic_task [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82046) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 13:52:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:52:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:52:37 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:52:37 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:52:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:52:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:37 devstack sudo[88375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:52:37 devstack sudo[88375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:37 devstack sudo[88368]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a7426233-86ef-4714-9b29-91c421f5a79e tempest-VolumesCloneTest-953879006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c 1073741824" returned: 0 in 0.731s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a7426233-86ef-4714-9b29-91c421f5a79e tempest-VolumesCloneTest-953879006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:38 devstack sudo[88377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c Apr 24 13:52:38 devstack sudo[88377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-69cfd05a-74f8-424d-b656-dbb446ff48bc tempest-VolumesSnapshotTestJSON-952003017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:52:38 devstack sudo[88375]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.599s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:38 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:52:38 devstack sudo[88377]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a7426233-86ef-4714-9b29-91c421f5a79e tempest-VolumesCloneTest-953879006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c" returned: 0 in 0.535s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:38 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a7426233-86ef-4714-9b29-91c421f5a79e tempest-VolumesCloneTest-953879006 None] <== create_volume: return (1325ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:52:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a7426233-86ef-4714-9b29-91c421f5a79e tempest-VolumesCloneTest-953879006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.327s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:52:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0e7176ae-82a6-474a-a3c0-66e9d9696ca6 tempest-SnapshotsActionsTest-323206228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.086s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:52:38 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-0e7176ae-82a6-474a-a3c0-66e9d9696ca6 tempest-SnapshotsActionsTest-323206228 None] Creating offline snapshot 081719dd-9c2a-4975-a501-ffe24e76ec65 of volume 44a6110a-61e2-4992-af85-a51911520efd {{(pid=82046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 13:52:38 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a7426233-86ef-4714-9b29-91c421f5a79e tempest-VolumesCloneTest-953879006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b0d3611-ffe4-442c-a06b-15c54c32eec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cd0e687-792a-4a73-9c15-8084ecfc186c', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:38 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a7426233-86ef-4714-9b29-91c421f5a79e tempest-VolumesCloneTest-953879006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c2e2b26-2e19-4b07-a155-f5fe7652bcbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:38 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64c3588-7fbf-4842-bcda-f833efedcb81]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:52:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0e7176ae-82a6-474a-a3c0-66e9d9696ca6 tempest-SnapshotsActionsTest-323206228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:38 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-a7426233-86ef-4714-9b29-91c421f5a79e tempest-VolumesCloneTest-953879006 None] Volume volume-4cd0e687-792a-4a73-9c15-8084ecfc186c (4cd0e687-792a-4a73-9c15-8084ecfc186c): created successfully Apr 24 13:52:38 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a7426233-86ef-4714-9b29-91c421f5a79e tempest-VolumesCloneTest-953879006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c2e2b26-2e19-4b07-a155-f5fe7652bcbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:38 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a7426233-86ef-4714-9b29-91c421f5a79e tempest-VolumesCloneTest-953879006 None] Flow 'volume_create_manager' (18455706-cc06-4b9c-b5de-7b6425358d2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:52:38 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-a7426233-86ef-4714-9b29-91c421f5a79e tempest-VolumesCloneTest-953879006 None] Created volume successfully. Apr 24 13:52:38 devstack sudo[88381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e Apr 24 13:52:38 devstack sudo[88381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:39 devstack sudo[88381]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0e7176ae-82a6-474a-a3c0-66e9d9696ca6 tempest-SnapshotsActionsTest-323206228 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e" returned: 0 in 0.570s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:39 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-0e7176ae-82a6-474a-a3c0-66e9d9696ca6 tempest-SnapshotsActionsTest-323206228 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44a6110a-61e2-4992-af85-a51911520efd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:52:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0e7176ae-82a6-474a-a3c0-66e9d9696ca6 tempest-SnapshotsActionsTest-323206228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.081719dd-9c2a-4975-a501-ffe24e76ec65 1G {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:39 devstack sudo[88386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.081719dd-9c2a-4975-a501-ffe24e76ec65 1G Apr 24 13:52:39 devstack sudo[88386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:39 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:52:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Flow 'volume_create_manager' (8278e836-6000-4364-9d32-5d85cf55c676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:52:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (970628cd-ee29-4ee4-8dad-1f727a5472a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (970628cd-ee29-4ee4-8dad-1f727a5472a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:52:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1667565453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ada72b41-9048-4462-80a5-ddae44a55396,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba486509ab39440fab66ba47d49fc277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:52:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=4cd0e687-792a-4a73-9c15-8084ecfc186c,status='creating',terminated_at=None,updated_at=2026-04-24T11:52:40Z,use_quota=True,user_id='5e1cdd797b4c46848280a0ad16539136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b35e96d6-8b24-42e1-b97f-8d1c8866207b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b35e96d6-8b24-42e1-b97f-8d1c8866207b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6b1e48a-b311-4fe0-8437-107cda492a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6b1e48a-b311-4fe0-8437-107cda492a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ada72b41-9048-4462-80a5-ddae44a55396', 'volume_name': 'volume-ada72b41-9048-4462-80a5-ddae44a55396', 'volume_size': 2, 'source_volid': '4cd0e687-792a-4a73-9c15-8084ecfc186c', 'source_volstatus': 'available'}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8531dad4-98cb-482a-90d9-66b559231de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8531dad4-98cb-482a-90d9-66b559231de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (783feb6a-c64f-4d1d-93df-789b1b8866aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:39 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Volume ada72b41-9048-4462-80a5-ddae44a55396: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ada72b41-9048-4462-80a5-ddae44a55396', 'volume_size': 2, 'source_volid': '4cd0e687-792a-4a73-9c15-8084ecfc186c', 'source_volstatus': 'available'} Apr 24 13:52:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:52:39 devstack sudo[88386]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0e7176ae-82a6-474a-a3c0-66e9d9696ca6 tempest-SnapshotsActionsTest-323206228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.081719dd-9c2a-4975-a501-ffe24e76ec65 1G" returned: 0 in 0.765s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0e7176ae-82a6-474a-a3c0-66e9d9696ca6 tempest-SnapshotsActionsTest-323206228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.081719dd-9c2a-4975-a501-ffe24e76ec65 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:39 devstack sudo[88391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.081719dd-9c2a-4975-a501-ffe24e76ec65 Apr 24 13:52:39 devstack sudo[88391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:40 devstack sudo[88391]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:40 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0e7176ae-82a6-474a-a3c0-66e9d9696ca6 tempest-SnapshotsActionsTest-323206228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.081719dd-9c2a-4975-a501-ffe24e76ec65" returned: 0 in 0.588s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:40 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-0e7176ae-82a6-474a-a3c0-66e9d9696ca6 tempest-SnapshotsActionsTest-323206228 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.081719dd-9c2a-4975-a501-ffe24e76ec65 is being set with open permissions: ugo+rw Apr 24 13:52:40 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0e7176ae-82a6-474a-a3c0-66e9d9696ca6 tempest-SnapshotsActionsTest-323206228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.081719dd-9c2a-4975-a501-ffe24e76ec65 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:40 devstack sudo[88396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.081719dd-9c2a-4975-a501-ffe24e76ec65 Apr 24 13:52:40 devstack sudo[88396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:41 devstack sudo[88396]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0e7176ae-82a6-474a-a3c0-66e9d9696ca6 tempest-SnapshotsActionsTest-323206228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.081719dd-9c2a-4975-a501-ffe24e76ec65" returned: 0 in 0.533s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0e7176ae-82a6-474a-a3c0-66e9d9696ca6 tempest-SnapshotsActionsTest-323206228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.570s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:52:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-69cfd05a-74f8-424d-b656-dbb446ff48bc tempest-VolumesSnapshotTestJSON-952003017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.678s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:52:41 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-69cfd05a-74f8-424d-b656-dbb446ff48bc tempest-VolumesSnapshotTestJSON-952003017 None] Creating offline snapshot 4fa60b4a-793e-453e-9379-06f34eb06fe0 of volume 78f402c7-4a8d-428f-ac00-20d12c72157d {{(pid=82046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 13:52:41 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[69fbc651-8d5c-4fe7-bc0e-624def8ccaf5]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:52:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-69cfd05a-74f8-424d-b656-dbb446ff48bc tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-78f402c7-4a8d-428f-ac00-20d12c72157d {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:41 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-0e7176ae-82a6-474a-a3c0-66e9d9696ca6 tempest-SnapshotsActionsTest-323206228 None] Create snapshot completed successfully Apr 24 13:52:41 devstack sudo[88399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-78f402c7-4a8d-428f-ac00-20d12c72157d Apr 24 13:52:41 devstack sudo[88399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:41 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-2e11cdfa-eb21-48d7-845a-31478bdaace7 tempest-SnapshotsActionsTest-786780460 None] Acquiring lock "cinder-081719dd-9c2a-4975-a501-ffe24e76ec65-delete_snapshot" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:52:41 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-2e11cdfa-eb21-48d7-845a-31478bdaace7 tempest-SnapshotsActionsTest-786780460 None] Lock "cinder-081719dd-9c2a-4975-a501-ffe24e76ec65-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:52:41 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-2e11cdfa-eb21-48d7-845a-31478bdaace7 tempest-SnapshotsActionsTest-786780460 None] Acquiring lock "cinder-quobyte-44a6110a-61e2-4992-af85-a51911520efd" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:52:41 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-2e11cdfa-eb21-48d7-845a-31478bdaace7 tempest-SnapshotsActionsTest-786780460 None] Lock "cinder-quobyte-44a6110a-61e2-4992-af85-a51911520efd" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:52:41 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-2e11cdfa-eb21-48d7-845a-31478bdaace7 tempest-SnapshotsActionsTest-786780460 None] Acquiring lock "cinder-quobyte-081719dd-9c2a-4975-a501-ffe24e76ec65" by "_delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:52:41 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-2e11cdfa-eb21-48d7-845a-31478bdaace7 tempest-SnapshotsActionsTest-786780460 None] Lock "cinder-quobyte-081719dd-9c2a-4975-a501-ffe24e76ec65" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:52:41 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-2e11cdfa-eb21-48d7-845a-31478bdaace7 tempest-SnapshotsActionsTest-786780460 None] Deleting offline snapshot 081719dd-9c2a-4975-a501-ffe24e76ec65 of volume 44a6110a-61e2-4992-af85-a51911520efd {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 13:52:41 devstack sudo[88399]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:41 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-2e11cdfa-eb21-48d7-845a-31478bdaace7 tempest-SnapshotsActionsTest-786780460 None] snapshot_file for this snap is: volume-44a6110a-61e2-4992-af85-a51911520efd.081719dd-9c2a-4975-a501-ffe24e76ec65 {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 13:52:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-69cfd05a-74f8-424d-b656-dbb446ff48bc tempest-VolumesSnapshotTestJSON-952003017 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-78f402c7-4a8d-428f-ac00-20d12c72157d" returned: 0 in 0.704s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-69cfd05a-74f8-424d-b656-dbb446ff48bc tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-78f402c7-4a8d-428f-ac00-20d12c72157d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-78f402c7-4a8d-428f-ac00-20d12c72157d.4fa60b4a-793e-453e-9379-06f34eb06fe0 1G {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:41 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[0843c398-3d2c-45f5-8304-570441c67705]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:52:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2e11cdfa-eb21-48d7-845a-31478bdaace7 tempest-SnapshotsActionsTest-786780460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.081719dd-9c2a-4975-a501-ffe24e76ec65 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:41 devstack sudo[88404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-78f402c7-4a8d-428f-ac00-20d12c72157d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-78f402c7-4a8d-428f-ac00-20d12c72157d.4fa60b4a-793e-453e-9379-06f34eb06fe0 1G Apr 24 13:52:41 devstack sudo[88404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:41 devstack sudo[88405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.081719dd-9c2a-4975-a501-ffe24e76ec65 Apr 24 13:52:41 devstack sudo[88405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:42 devstack sudo[88405]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:42 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2e11cdfa-eb21-48d7-845a-31478bdaace7 tempest-SnapshotsActionsTest-786780460 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.081719dd-9c2a-4975-a501-ffe24e76ec65" returned: 0 in 0.664s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:42 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-2e11cdfa-eb21-48d7-845a-31478bdaace7 tempest-SnapshotsActionsTest-786780460 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44a6110a-61e2-4992-af85-a51911520efd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:52:42 devstack sudo[88404]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:42 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-69cfd05a-74f8-424d-b656-dbb446ff48bc tempest-VolumesSnapshotTestJSON-952003017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-78f402c7-4a8d-428f-ac00-20d12c72157d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-78f402c7-4a8d-428f-ac00-20d12c72157d.4fa60b4a-793e-453e-9379-06f34eb06fe0 1G" returned: 0 in 0.703s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:42 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-69cfd05a-74f8-424d-b656-dbb446ff48bc tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78f402c7-4a8d-428f-ac00-20d12c72157d -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-78f402c7-4a8d-428f-ac00-20d12c72157d.4fa60b4a-793e-453e-9379-06f34eb06fe0 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:42 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a93e3e9-6433-49ad-9589-44fbc9957087]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:52:42 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2e11cdfa-eb21-48d7-845a-31478bdaace7 tempest-SnapshotsActionsTest-786780460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:42 devstack sudo[88414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78f402c7-4a8d-428f-ac00-20d12c72157d -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-78f402c7-4a8d-428f-ac00-20d12c72157d.4fa60b4a-793e-453e-9379-06f34eb06fe0 Apr 24 13:52:42 devstack sudo[88414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:42 devstack sudo[88415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e Apr 24 13:52:42 devstack sudo[88415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:43 devstack sudo[88414]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-69cfd05a-74f8-424d-b656-dbb446ff48bc tempest-VolumesSnapshotTestJSON-952003017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78f402c7-4a8d-428f-ac00-20d12c72157d -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-78f402c7-4a8d-428f-ac00-20d12c72157d.4fa60b4a-793e-453e-9379-06f34eb06fe0" returned: 0 in 0.588s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:43 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-69cfd05a-74f8-424d-b656-dbb446ff48bc tempest-VolumesSnapshotTestJSON-952003017 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-78f402c7-4a8d-428f-ac00-20d12c72157d.4fa60b4a-793e-453e-9379-06f34eb06fe0 is being set with open permissions: ugo+rw Apr 24 13:52:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-69cfd05a-74f8-424d-b656-dbb446ff48bc tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-78f402c7-4a8d-428f-ac00-20d12c72157d.4fa60b4a-793e-453e-9379-06f34eb06fe0 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:43 devstack sudo[88424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-78f402c7-4a8d-428f-ac00-20d12c72157d.4fa60b4a-793e-453e-9379-06f34eb06fe0 Apr 24 13:52:43 devstack sudo[88424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:43 devstack sudo[88415]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2e11cdfa-eb21-48d7-845a-31478bdaace7 tempest-SnapshotsActionsTest-786780460 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e" returned: 0 in 0.619s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:43 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-2e11cdfa-eb21-48d7-845a-31478bdaace7 tempest-SnapshotsActionsTest-786780460 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44a6110a-61e2-4992-af85-a51911520efd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:52:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2e11cdfa-eb21-48d7-845a-31478bdaace7 tempest-SnapshotsActionsTest-786780460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.081719dd-9c2a-4975-a501-ffe24e76ec65 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:43 devstack sudo[88426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.081719dd-9c2a-4975-a501-ffe24e76ec65 Apr 24 13:52:43 devstack sudo[88426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:43 devstack sudo[88424]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-69cfd05a-74f8-424d-b656-dbb446ff48bc tempest-VolumesSnapshotTestJSON-952003017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-78f402c7-4a8d-428f-ac00-20d12c72157d.4fa60b4a-793e-453e-9379-06f34eb06fe0" returned: 0 in 0.542s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-69cfd05a-74f8-424d-b656-dbb446ff48bc tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-78f402c7-4a8d-428f-ac00-20d12c72157d.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:43 devstack sudo[88432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-78f402c7-4a8d-428f-ac00-20d12c72157d.info Apr 24 13:52:43 devstack sudo[88432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:43 devstack sudo[88426]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2e11cdfa-eb21-48d7-845a-31478bdaace7 tempest-SnapshotsActionsTest-786780460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.081719dd-9c2a-4975-a501-ffe24e76ec65" returned: 0 in 0.738s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2e11cdfa-eb21-48d7-845a-31478bdaace7 tempest-SnapshotsActionsTest-786780460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.081719dd-9c2a-4975-a501-ffe24e76ec65 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:43 devstack sudo[88434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.081719dd-9c2a-4975-a501-ffe24e76ec65 Apr 24 13:52:43 devstack sudo[88434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:44 devstack sudo[88432]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-69cfd05a-74f8-424d-b656-dbb446ff48bc tempest-VolumesSnapshotTestJSON-952003017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-78f402c7-4a8d-428f-ac00-20d12c72157d.info" returned: 0 in 0.595s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:44 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-69cfd05a-74f8-424d-b656-dbb446ff48bc tempest-VolumesSnapshotTestJSON-952003017 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-78f402c7-4a8d-428f-ac00-20d12c72157d.info is being set with open permissions: ugo+rw Apr 24 13:52:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-69cfd05a-74f8-424d-b656-dbb446ff48bc tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-78f402c7-4a8d-428f-ac00-20d12c72157d.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:44 devstack sudo[88438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-78f402c7-4a8d-428f-ac00-20d12c72157d.info Apr 24 13:52:44 devstack sudo[88438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:44 devstack sudo[88434]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2e11cdfa-eb21-48d7-845a-31478bdaace7 tempest-SnapshotsActionsTest-786780460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.081719dd-9c2a-4975-a501-ffe24e76ec65" returned: 0 in 0.479s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:44 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-2e11cdfa-eb21-48d7-845a-31478bdaace7 tempest-SnapshotsActionsTest-786780460 None] Lock "cinder-quobyte-081719dd-9c2a-4975-a501-ffe24e76ec65" released by "_delete_snapshot" :: held 2.622s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:52:44 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-2e11cdfa-eb21-48d7-845a-31478bdaace7 tempest-SnapshotsActionsTest-786780460 None] Lock "cinder-quobyte-44a6110a-61e2-4992-af85-a51911520efd" released by "delete_snapshot" :: held 2.658s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:52:44 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-2e11cdfa-eb21-48d7-845a-31478bdaace7 tempest-SnapshotsActionsTest-786780460 None] Created reservations ['684b0611-37c3-4bc4-b622-8e48556a258d', '4b9114bf-9e9a-481a-93ef-101943758b11', '5e77135c-798c-46bd-95f4-9c107494e95d', '2df03c22-2622-433f-9464-2e88e10bd6be'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:52:44 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-2e11cdfa-eb21-48d7-845a-31478bdaace7 tempest-SnapshotsActionsTest-786780460 None] Delete snapshot completed successfully. Apr 24 13:52:44 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-2e11cdfa-eb21-48d7-845a-31478bdaace7 tempest-SnapshotsActionsTest-786780460 None] Lock "cinder-081719dd-9c2a-4975-a501-ffe24e76ec65-delete_snapshot" released by "delete_snapshot" :: held 2.829s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:52:44 devstack sudo[88438]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-69cfd05a-74f8-424d-b656-dbb446ff48bc tempest-VolumesSnapshotTestJSON-952003017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-78f402c7-4a8d-428f-ac00-20d12c72157d.info" returned: 0 in 0.498s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-69cfd05a-74f8-424d-b656-dbb446ff48bc tempest-VolumesSnapshotTestJSON-952003017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.743s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:52:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 4.985s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:52:44 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Cloning volume 4cd0e687-792a-4a73-9c15-8084ecfc186c to volume ada72b41-9048-4462-80a5-ddae44a55396 Apr 24 13:52:44 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Creating offline snapshot 17ad7b6b-9357-489c-b49a-68b2a1810638 of volume 4cd0e687-792a-4a73-9c15-8084ecfc186c {{(pid=82046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 13:52:44 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[295997db-af6e-416e-91ba-7cced495287f]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:52:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:44 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-69cfd05a-74f8-424d-b656-dbb446ff48bc tempest-VolumesSnapshotTestJSON-952003017 None] Create snapshot completed successfully Apr 24 13:52:45 devstack sudo[88441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c Apr 24 13:52:45 devstack sudo[88441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d984877a-1863-49d0-a517-ac9ed60673a6 tempest-SnapshotsActionsTest-323206228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:52:45 devstack sudo[88441]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c" returned: 0 in 0.699s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c.17ad7b6b-9357-489c-b49a-68b2a1810638 1G {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:45 devstack sudo[88447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c.17ad7b6b-9357-489c-b49a-68b2a1810638 1G Apr 24 13:52:45 devstack sudo[88447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:45 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-41b10dd8-ad06-40d2-b256-a58902f68280 tempest-VolumesSnapshotTestJSON-952003017 None] Acquiring lock "cinder-4fa60b4a-793e-453e-9379-06f34eb06fe0-delete_snapshot" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:52:46 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-41b10dd8-ad06-40d2-b256-a58902f68280 tempest-VolumesSnapshotTestJSON-952003017 None] Lock "cinder-4fa60b4a-793e-453e-9379-06f34eb06fe0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:52:46 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-41b10dd8-ad06-40d2-b256-a58902f68280 tempest-VolumesSnapshotTestJSON-952003017 None] Acquiring lock "cinder-quobyte-78f402c7-4a8d-428f-ac00-20d12c72157d" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:52:46 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-41b10dd8-ad06-40d2-b256-a58902f68280 tempest-VolumesSnapshotTestJSON-952003017 None] Lock "cinder-quobyte-78f402c7-4a8d-428f-ac00-20d12c72157d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:52:46 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-41b10dd8-ad06-40d2-b256-a58902f68280 tempest-VolumesSnapshotTestJSON-952003017 None] Acquiring lock "cinder-quobyte-4fa60b4a-793e-453e-9379-06f34eb06fe0" by "_delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:52:46 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-41b10dd8-ad06-40d2-b256-a58902f68280 tempest-VolumesSnapshotTestJSON-952003017 None] Lock "cinder-quobyte-4fa60b4a-793e-453e-9379-06f34eb06fe0" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:52:46 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-41b10dd8-ad06-40d2-b256-a58902f68280 tempest-VolumesSnapshotTestJSON-952003017 None] Deleting offline snapshot 4fa60b4a-793e-453e-9379-06f34eb06fe0 of volume 78f402c7-4a8d-428f-ac00-20d12c72157d {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 13:52:46 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-41b10dd8-ad06-40d2-b256-a58902f68280 tempest-VolumesSnapshotTestJSON-952003017 None] snapshot_file for this snap is: volume-78f402c7-4a8d-428f-ac00-20d12c72157d.4fa60b4a-793e-453e-9379-06f34eb06fe0 {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 13:52:46 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d08cc15-b53b-4c23-9742-a294cfdd7b88]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:52:46 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-41b10dd8-ad06-40d2-b256-a58902f68280 tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-78f402c7-4a8d-428f-ac00-20d12c72157d.4fa60b4a-793e-453e-9379-06f34eb06fe0 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:46 devstack sudo[88452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-78f402c7-4a8d-428f-ac00-20d12c72157d.4fa60b4a-793e-453e-9379-06f34eb06fe0 Apr 24 13:52:46 devstack sudo[88452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:46 devstack sudo[88447]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:46 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c.17ad7b6b-9357-489c-b49a-68b2a1810638 1G" returned: 0 in 0.678s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:46 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cd0e687-792a-4a73-9c15-8084ecfc186c -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c.17ad7b6b-9357-489c-b49a-68b2a1810638 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:46 devstack sudo[88454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cd0e687-792a-4a73-9c15-8084ecfc186c -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c.17ad7b6b-9357-489c-b49a-68b2a1810638 Apr 24 13:52:46 devstack sudo[88454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:46 devstack sudo[88452]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:46 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-41b10dd8-ad06-40d2-b256-a58902f68280 tempest-VolumesSnapshotTestJSON-952003017 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-78f402c7-4a8d-428f-ac00-20d12c72157d.4fa60b4a-793e-453e-9379-06f34eb06fe0" returned: 0 in 0.690s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:46 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-41b10dd8-ad06-40d2-b256-a58902f68280 tempest-VolumesSnapshotTestJSON-952003017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78f402c7-4a8d-428f-ac00-20d12c72157d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:52:46 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[52667174-1cda-477d-b372-2ecaeb8ab352]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:52:46 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-41b10dd8-ad06-40d2-b256-a58902f68280 tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-78f402c7-4a8d-428f-ac00-20d12c72157d {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:46 devstack sudo[88462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-78f402c7-4a8d-428f-ac00-20d12c72157d Apr 24 13:52:46 devstack sudo[88462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:46 devstack sudo[88454]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:46 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cd0e687-792a-4a73-9c15-8084ecfc186c -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c.17ad7b6b-9357-489c-b49a-68b2a1810638" returned: 0 in 0.640s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:46 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c.17ad7b6b-9357-489c-b49a-68b2a1810638 is being set with open permissions: ugo+rw Apr 24 13:52:46 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c.17ad7b6b-9357-489c-b49a-68b2a1810638 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:47 devstack sudo[88464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c.17ad7b6b-9357-489c-b49a-68b2a1810638 Apr 24 13:52:47 devstack sudo[88464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:47 devstack sudo[88462]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-41b10dd8-ad06-40d2-b256-a58902f68280 tempest-VolumesSnapshotTestJSON-952003017 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-78f402c7-4a8d-428f-ac00-20d12c72157d" returned: 0 in 0.668s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-41b10dd8-ad06-40d2-b256-a58902f68280 tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-78f402c7-4a8d-428f-ac00-20d12c72157d.4fa60b4a-793e-453e-9379-06f34eb06fe0 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:47 devstack sudo[88470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-78f402c7-4a8d-428f-ac00-20d12c72157d.4fa60b4a-793e-453e-9379-06f34eb06fe0 Apr 24 13:52:47 devstack sudo[88470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:47 devstack sudo[88464]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c.17ad7b6b-9357-489c-b49a-68b2a1810638" returned: 0 in 0.602s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:47 devstack cinder-volume[82046]: DEBUG dbcounter [-] [82046] Writing DB stats cinder:SELECT=81,cinder:INSERT=28,cinder:UPDATE=87,cinder:DELETE=8 {{(pid=82046) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 13:52:47 devstack cinder-volume[82046]: DEBUG dbcounter [-] [82046] Writing DB stats cinder:UPDATE=103,cinder:SELECT=77,cinder:DELETE=11,cinder:INSERT=16 {{(pid=82046) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 13:52:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:47 devstack sudo[88472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c.info Apr 24 13:52:47 devstack sudo[88472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:48 devstack sudo[88472]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c.info" returned: 0 in 0.536s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:48 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c.info is being set with open permissions: ugo+rw Apr 24 13:52:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:48 devstack sudo[88478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c.info Apr 24 13:52:48 devstack sudo[88478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:48 devstack sudo[88470]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-41b10dd8-ad06-40d2-b256-a58902f68280 tempest-VolumesSnapshotTestJSON-952003017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-78f402c7-4a8d-428f-ac00-20d12c72157d.4fa60b4a-793e-453e-9379-06f34eb06fe0" returned: 0 in 0.655s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-41b10dd8-ad06-40d2-b256-a58902f68280 tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-78f402c7-4a8d-428f-ac00-20d12c72157d.4fa60b4a-793e-453e-9379-06f34eb06fe0 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:48 devstack sudo[88480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-78f402c7-4a8d-428f-ac00-20d12c72157d.4fa60b4a-793e-453e-9379-06f34eb06fe0 Apr 24 13:52:48 devstack sudo[88480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:48 devstack sudo[88478]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c.info" returned: 0 in 0.484s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:48 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Acquiring lock "cinder-quobyte-ada72b41-9048-4462-80a5-ddae44a55396" by "_copy_volume_from_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:52:48 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Lock "cinder-quobyte-ada72b41-9048-4462-80a5-ddae44a55396" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:52:48 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] snapshot: 17ad7b6b-9357-489c-b49a-68b2a1810638, volume: ada72b41-9048-4462-80a5-ddae44a55396, {{(pid=82046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 13:52:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:52:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:52:48 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:52:48 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:52:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:52:48 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5fd59d-dfd0-47d6-851e-4821b7d7960a]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:52:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c.17ad7b6b-9357-489c-b49a-68b2a1810638 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:48 devstack sudo[88480]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-41b10dd8-ad06-40d2-b256-a58902f68280 tempest-VolumesSnapshotTestJSON-952003017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-78f402c7-4a8d-428f-ac00-20d12c72157d.4fa60b4a-793e-453e-9379-06f34eb06fe0" returned: 0 in 0.542s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:48 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-41b10dd8-ad06-40d2-b256-a58902f68280 tempest-VolumesSnapshotTestJSON-952003017 None] Lock "cinder-quobyte-4fa60b4a-793e-453e-9379-06f34eb06fe0" released by "_delete_snapshot" :: held 2.677s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:52:48 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-41b10dd8-ad06-40d2-b256-a58902f68280 tempest-VolumesSnapshotTestJSON-952003017 None] Lock "cinder-quobyte-78f402c7-4a8d-428f-ac00-20d12c72157d" released by "delete_snapshot" :: held 2.704s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:52:48 devstack sudo[88484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c.17ad7b6b-9357-489c-b49a-68b2a1810638 Apr 24 13:52:48 devstack sudo[88484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:48 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-41b10dd8-ad06-40d2-b256-a58902f68280 tempest-VolumesSnapshotTestJSON-952003017 None] Created reservations ['ba2e216d-ce4d-42e2-be55-04798dd8a3b6', '651bac6a-c7d4-4ebf-a6d8-21c584014e45', '5faea553-b31f-4f90-9592-aba5b1ada463', 'c02af81a-d3af-406b-a5cb-771974d2d919'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:52:48 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-41b10dd8-ad06-40d2-b256-a58902f68280 tempest-VolumesSnapshotTestJSON-952003017 None] Delete snapshot completed successfully. Apr 24 13:52:48 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-41b10dd8-ad06-40d2-b256-a58902f68280 tempest-VolumesSnapshotTestJSON-952003017 None] Lock "cinder-4fa60b4a-793e-453e-9379-06f34eb06fe0-delete_snapshot" released by "delete_snapshot" :: held 2.928s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:52:49 devstack sudo[88484]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c.17ad7b6b-9357-489c-b49a-68b2a1810638" returned: 0 in 0.696s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:49 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cd0e687-792a-4a73-9c15-8084ecfc186c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:52:49 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c {{(pid=82046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 13:52:49 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Creating direct copy from snapshot {{(pid=82046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 13:52:49 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1ff380-cae6-437b-bce9-2ccedd32e5de]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:52:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:49 devstack sudo[88489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c Apr 24 13:52:49 devstack sudo[88489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:49 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7d2197a-ff40-4664-8c68-f3a15fc87e99 tempest-VolumesSnapshotTestJSON-952003017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:52:49 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b7d2197a-ff40-4664-8c68-f3a15fc87e99 tempest-VolumesSnapshotTestJSON-952003017 None] Flow 'volume_create_manager' (f7f53575-c7b4-4bb3-8a5b-7c69a70a6cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:52:49 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b7d2197a-ff40-4664-8c68-f3a15fc87e99 tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d865c05e-6870-4e0a-bd7e-be222bfc8796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:49 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b7d2197a-ff40-4664-8c68-f3a15fc87e99 tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d865c05e-6870-4e0a-bd7e-be222bfc8796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1469503061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aecf75e-6c54-409f-b33a-5936d3370740,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81778cce064e41cca9db08dd8c34436d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:52:50Z,use_quota=True,user_id='828592763a7247db9e1ebd1796caa21e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:49 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b7d2197a-ff40-4664-8c68-f3a15fc87e99 tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2af03166-4da4-4e27-a418-95ef52d5bf8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:49 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b7d2197a-ff40-4664-8c68-f3a15fc87e99 tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2af03166-4da4-4e27-a418-95ef52d5bf8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:49 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b7d2197a-ff40-4664-8c68-f3a15fc87e99 tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b0bc409-5a8a-4540-8930-c2fb69cf5a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:49 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b7d2197a-ff40-4664-8c68-f3a15fc87e99 tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b0bc409-5a8a-4540-8930-c2fb69cf5a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7aecf75e-6c54-409f-b33a-5936d3370740', 'volume_name': 'volume-7aecf75e-6c54-409f-b33a-5936d3370740', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:49 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b7d2197a-ff40-4664-8c68-f3a15fc87e99 tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7254050c-af10-4866-abe2-de19e9e06f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:49 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b7d2197a-ff40-4664-8c68-f3a15fc87e99 tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7254050c-af10-4866-abe2-de19e9e06f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:49 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b7d2197a-ff40-4664-8c68-f3a15fc87e99 tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c729fd4-0dfd-4c84-ac81-a89adc2815ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:49 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-b7d2197a-ff40-4664-8c68-f3a15fc87e99 tempest-VolumesSnapshotTestJSON-952003017 None] Volume 7aecf75e-6c54-409f-b33a-5936d3370740: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7aecf75e-6c54-409f-b33a-5936d3370740', 'volume_size': 1} Apr 24 13:52:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b7d2197a-ff40-4664-8c68-f3a15fc87e99 tempest-VolumesSnapshotTestJSON-952003017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:52:50 devstack sudo[88489]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c" returned: 0 in 0.644s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:50 devstack cinder-volume[82046]: DEBUG cinder.utils [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Path /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-ada72b41-9048-4462-80a5-ddae44a55396 not found in is_blk_device check {{(pid=82046) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 13:52:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-ada72b41-9048-4462-80a5-ddae44a55396 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:50 devstack sudo[88500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-ada72b41-9048-4462-80a5-ddae44a55396 Apr 24 13:52:50 devstack sudo[88500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:54 devstack sudo[88500]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:54 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-ada72b41-9048-4462-80a5-ddae44a55396" returned: 0 in 4.822s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:54 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[da34a52f-34e2-47ce-9d8a-625411e3336b]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:52:54 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:55 devstack sudo[88513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c Apr 24 13:52:55 devstack sudo[88513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:55 devstack sudo[88513]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:55 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c" returned: 0 in 0.688s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:55 devstack cinder-volume[82046]: DEBUG cinder.image.image_utils [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Image conversion details: src /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c, size 1024.00 MB, duration 4.82 sec, destination /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-ada72b41-9048-4462-80a5-ddae44a55396 {{(pid=82046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 13:52:55 devstack cinder-volume[82046]: INFO cinder.image.image_utils [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Converted 1024.00 MB image at 212.30 MB/s Apr 24 13:52:55 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-ada72b41-9048-4462-80a5-ddae44a55396 is being set with open permissions: ugo+rw Apr 24 13:52:55 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-ada72b41-9048-4462-80a5-ddae44a55396 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:55 devstack sudo[88519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-ada72b41-9048-4462-80a5-ddae44a55396 Apr 24 13:52:55 devstack sudo[88519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:56 devstack sudo[88519]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:56 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-ada72b41-9048-4462-80a5-ddae44a55396" returned: 0 in 0.447s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:56 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Lock "cinder-quobyte-ada72b41-9048-4462-80a5-ddae44a55396" released by "_copy_volume_from_snapshot" :: held 7.384s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:52:56 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Acquiring lock "cinder-quobyte-17ad7b6b-9357-489c-b49a-68b2a1810638" by "_delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:52:56 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Lock "cinder-quobyte-17ad7b6b-9357-489c-b49a-68b2a1810638" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:52:56 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Deleting offline snapshot 17ad7b6b-9357-489c-b49a-68b2a1810638 of volume 4cd0e687-792a-4a73-9c15-8084ecfc186c {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 13:52:56 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] snapshot_file for this snap is: volume-4cd0e687-792a-4a73-9c15-8084ecfc186c.17ad7b6b-9357-489c-b49a-68b2a1810638 {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 13:52:56 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ecb11a-4d32-41a2-aa25-e1050a98ac86]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:52:56 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c.17ad7b6b-9357-489c-b49a-68b2a1810638 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:56 devstack sudo[88522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c.17ad7b6b-9357-489c-b49a-68b2a1810638 Apr 24 13:52:56 devstack sudo[88522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:56 devstack sudo[88522]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:56 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c.17ad7b6b-9357-489c-b49a-68b2a1810638" returned: 0 in 0.524s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:56 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cd0e687-792a-4a73-9c15-8084ecfc186c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:52:56 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b38f1fe-8786-49b9-b655-d8b34dd887d2]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:52:56 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:56 devstack sudo[88527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c Apr 24 13:52:56 devstack sudo[88527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:57 devstack sudo[88527]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:57 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c" returned: 0 in 0.513s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:57 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c.17ad7b6b-9357-489c-b49a-68b2a1810638 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:57 devstack sudo[88532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c.17ad7b6b-9357-489c-b49a-68b2a1810638 Apr 24 13:52:57 devstack sudo[88532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:57 devstack sudo[88532]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:57 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c.17ad7b6b-9357-489c-b49a-68b2a1810638" returned: 0 in 0.575s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:57 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c.17ad7b6b-9357-489c-b49a-68b2a1810638 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:57 devstack sudo[88537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c.17ad7b6b-9357-489c-b49a-68b2a1810638 Apr 24 13:52:57 devstack sudo[88537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:58 devstack sudo[88537]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c.17ad7b6b-9357-489c-b49a-68b2a1810638" returned: 0 in 0.440s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:58 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Lock "cinder-quobyte-17ad7b6b-9357-489c-b49a-68b2a1810638" released by "_delete_snapshot" :: held 2.150s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:52:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.423s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:52:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d984877a-1863-49d0-a517-ac9ed60673a6 tempest-SnapshotsActionsTest-323206228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.944s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:52:58 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-d984877a-1863-49d0-a517-ac9ed60673a6 tempest-SnapshotsActionsTest-323206228 None] Creating offline snapshot 5cff40db-cb9b-423c-a98e-49bbcb224d13 of volume 44a6110a-61e2-4992-af85-a51911520efd {{(pid=82046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 13:52:58 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (783feb6a-c64f-4d1d-93df-789b1b8866aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ada72b41-9048-4462-80a5-ddae44a55396', 'volume_size': 2, 'source_volid': '4cd0e687-792a-4a73-9c15-8084ecfc186c', 'source_volstatus': 'available'}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:58 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe3f7577-68ba-4780-ad05-4b03df0f921d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:52:58 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[35dc7c14-c747-4b59-a53b-8d23d2791db4]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:52:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d984877a-1863-49d0-a517-ac9ed60673a6 tempest-SnapshotsActionsTest-323206228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:58 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Volume volume-ada72b41-9048-4462-80a5-ddae44a55396 (ada72b41-9048-4462-80a5-ddae44a55396): created successfully Apr 24 13:52:58 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe3f7577-68ba-4780-ad05-4b03df0f921d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:52:58 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Flow 'volume_create_manager' (8278e836-6000-4364-9d32-5d85cf55c676) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:52:58 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-fc38b698-6ed6-484f-a486-879881851b83 tempest-VolumesCloneTest-953879006 None] Created volume successfully. Apr 24 13:52:58 devstack sudo[88540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e Apr 24 13:52:58 devstack sudo[88540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:58 devstack sudo[88540]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d984877a-1863-49d0-a517-ac9ed60673a6 tempest-SnapshotsActionsTest-323206228 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e" returned: 0 in 0.588s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:58 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-d984877a-1863-49d0-a517-ac9ed60673a6 tempest-SnapshotsActionsTest-323206228 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44a6110a-61e2-4992-af85-a51911520efd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:52:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d984877a-1863-49d0-a517-ac9ed60673a6 tempest-SnapshotsActionsTest-323206228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.5cff40db-cb9b-423c-a98e-49bbcb224d13 1G {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:58 devstack sudo[88545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.5cff40db-cb9b-423c-a98e-49bbcb224d13 1G Apr 24 13:52:58 devstack sudo[88545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:59 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-3ba9969b-ce8f-4427-b3f7-b0097f41ec99 tempest-VolumesCloneTest-953879006 None] Acquiring lock "cinder-ada72b41-9048-4462-80a5-ddae44a55396-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:52:59 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-3ba9969b-ce8f-4427-b3f7-b0097f41ec99 tempest-VolumesCloneTest-953879006 None] Lock "cinder-ada72b41-9048-4462-80a5-ddae44a55396-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:52:59 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-3ba9969b-ce8f-4427-b3f7-b0097f41ec99 tempest-VolumesCloneTest-953879006 None] Acquiring lock "cinder-quobyte-ada72b41-9048-4462-80a5-ddae44a55396" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:52:59 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-3ba9969b-ce8f-4427-b3f7-b0097f41ec99 tempest-VolumesCloneTest-953879006 None] Lock "cinder-quobyte-ada72b41-9048-4462-80a5-ddae44a55396" acquired by "delete_volume" :: waited 0.018s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:52:59 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[64176cad-0b48-4724-8a25-a475eb48c3a1]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:52:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3ba9969b-ce8f-4427-b3f7-b0097f41ec99 tempest-VolumesCloneTest-953879006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-ada72b41-9048-4462-80a5-ddae44a55396 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:59 devstack sudo[88549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-ada72b41-9048-4462-80a5-ddae44a55396 Apr 24 13:52:59 devstack sudo[88549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:52:59 devstack sudo[88545]: pam_unix(sudo:session): session closed for user root Apr 24 13:52:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d984877a-1863-49d0-a517-ac9ed60673a6 tempest-SnapshotsActionsTest-323206228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.5cff40db-cb9b-423c-a98e-49bbcb224d13 1G" returned: 0 in 0.792s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:52:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d984877a-1863-49d0-a517-ac9ed60673a6 tempest-SnapshotsActionsTest-323206228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.5cff40db-cb9b-423c-a98e-49bbcb224d13 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:52:59 devstack sudo[88552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.5cff40db-cb9b-423c-a98e-49bbcb224d13 Apr 24 13:52:59 devstack sudo[88552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:00 devstack sudo[88549]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:00 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3ba9969b-ce8f-4427-b3f7-b0097f41ec99 tempest-VolumesCloneTest-953879006 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-ada72b41-9048-4462-80a5-ddae44a55396" returned: 0 in 0.626s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:00 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3ba9969b-ce8f-4427-b3f7-b0097f41ec99 tempest-VolumesCloneTest-953879006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-ada72b41-9048-4462-80a5-ddae44a55396 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:00 devstack sudo[88557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-ada72b41-9048-4462-80a5-ddae44a55396 Apr 24 13:53:00 devstack sudo[88557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:00 devstack sudo[88552]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:00 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d984877a-1863-49d0-a517-ac9ed60673a6 tempest-SnapshotsActionsTest-323206228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.5cff40db-cb9b-423c-a98e-49bbcb224d13" returned: 0 in 0.573s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:00 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-d984877a-1863-49d0-a517-ac9ed60673a6 tempest-SnapshotsActionsTest-323206228 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.5cff40db-cb9b-423c-a98e-49bbcb224d13 is being set with open permissions: ugo+rw Apr 24 13:53:00 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d984877a-1863-49d0-a517-ac9ed60673a6 tempest-SnapshotsActionsTest-323206228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.5cff40db-cb9b-423c-a98e-49bbcb224d13 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:00 devstack sudo[88562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.5cff40db-cb9b-423c-a98e-49bbcb224d13 Apr 24 13:53:00 devstack sudo[88562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:00 devstack sudo[88557]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:00 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3ba9969b-ce8f-4427-b3f7-b0097f41ec99 tempest-VolumesCloneTest-953879006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-ada72b41-9048-4462-80a5-ddae44a55396" returned: 0 in 0.504s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:00 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-3ba9969b-ce8f-4427-b3f7-b0097f41ec99 tempest-VolumesCloneTest-953879006 None] Lock "cinder-quobyte-ada72b41-9048-4462-80a5-ddae44a55396" released by "delete_volume" :: held 1.172s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:53:00 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-3ba9969b-ce8f-4427-b3f7-b0097f41ec99 tempest-VolumesCloneTest-953879006 None] Created reservations ['bfe17ab8-8d25-4968-be1a-0b18524dae8b', 'c300e799-a63d-46fd-a393-e9c0c7dac61e', '62e36f8c-9b3f-4c0d-8044-224d724a9af6', 'a25dfb2b-60e2-42e6-8662-f07f8295958f'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:53:00 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-3ba9969b-ce8f-4427-b3f7-b0097f41ec99 tempest-VolumesCloneTest-953879006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:53:00 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-3ba9969b-ce8f-4427-b3f7-b0097f41ec99 tempest-VolumesCloneTest-953879006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:53:00 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-3ba9969b-ce8f-4427-b3f7-b0097f41ec99 tempest-VolumesCloneTest-953879006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:53:00 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-3ba9969b-ce8f-4427-b3f7-b0097f41ec99 tempest-VolumesCloneTest-953879006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:53:00 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-3ba9969b-ce8f-4427-b3f7-b0097f41ec99 tempest-VolumesCloneTest-953879006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:53:00 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3ba9969b-ce8f-4427-b3f7-b0097f41ec99 tempest-VolumesCloneTest-953879006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:00 devstack sudo[88565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:53:00 devstack sudo[88565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:00 devstack sudo[88562]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:00 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d984877a-1863-49d0-a517-ac9ed60673a6 tempest-SnapshotsActionsTest-323206228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.5cff40db-cb9b-423c-a98e-49bbcb224d13" returned: 0 in 0.536s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:00 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d984877a-1863-49d0-a517-ac9ed60673a6 tempest-SnapshotsActionsTest-323206228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.606s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:53:00 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b7d2197a-ff40-4664-8c68-f3a15fc87e99 tempest-VolumesSnapshotTestJSON-952003017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.006s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:53:00 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b7d2197a-ff40-4664-8c68-f3a15fc87e99 tempest-VolumesSnapshotTestJSON-952003017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1469503061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aecf75e-6c54-409f-b33a-5936d3370740,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81778cce064e41cca9db08dd8c34436d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:52:50Z,use_quota=True,user_id='828592763a7247db9e1ebd1796caa21e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:53:00 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-b7d2197a-ff40-4664-8c68-f3a15fc87e99 tempest-VolumesSnapshotTestJSON-952003017 None] Creating volume 7aecf75e-6c54-409f-b33a-5936d3370740 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:53:00 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b7d2197a-ff40-4664-8c68-f3a15fc87e99 tempest-VolumesSnapshotTestJSON-952003017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:53:00 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b7d2197a-ff40-4664-8c68-f3a15fc87e99 tempest-VolumesSnapshotTestJSON-952003017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:53:00 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b7d2197a-ff40-4664-8c68-f3a15fc87e99 tempest-VolumesSnapshotTestJSON-952003017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:53:00 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b7d2197a-ff40-4664-8c68-f3a15fc87e99 tempest-VolumesSnapshotTestJSON-952003017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:53:00 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b7d2197a-ff40-4664-8c68-f3a15fc87e99 tempest-VolumesSnapshotTestJSON-952003017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:53:00 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b7d2197a-ff40-4664-8c68-f3a15fc87e99 tempest-VolumesSnapshotTestJSON-952003017 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:53:00 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-b7d2197a-ff40-4664-8c68-f3a15fc87e99 tempest-VolumesSnapshotTestJSON-952003017 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:53:00 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b7d2197a-ff40-4664-8c68-f3a15fc87e99 tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:00 devstack sudo[88568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740 1073741824 Apr 24 13:53:00 devstack sudo[88568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:00 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-d984877a-1863-49d0-a517-ac9ed60673a6 tempest-SnapshotsActionsTest-323206228 None] Create snapshot completed successfully Apr 24 13:53:01 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-a1dd8cd2-f640-4fa0-8869-815ac8cd077e tempest-SnapshotsActionsTest-786780460 None] Acquiring lock "cinder-5cff40db-cb9b-423c-a98e-49bbcb224d13-delete_snapshot" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:53:01 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-a1dd8cd2-f640-4fa0-8869-815ac8cd077e tempest-SnapshotsActionsTest-786780460 None] Lock "cinder-5cff40db-cb9b-423c-a98e-49bbcb224d13-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:53:01 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-a1dd8cd2-f640-4fa0-8869-815ac8cd077e tempest-SnapshotsActionsTest-786780460 None] Acquiring lock "cinder-quobyte-44a6110a-61e2-4992-af85-a51911520efd" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:53:01 devstack sudo[88565]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:01 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-a1dd8cd2-f640-4fa0-8869-815ac8cd077e tempest-SnapshotsActionsTest-786780460 None] Lock "cinder-quobyte-44a6110a-61e2-4992-af85-a51911520efd" acquired by "delete_snapshot" :: waited 0.031s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:53:01 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-a1dd8cd2-f640-4fa0-8869-815ac8cd077e tempest-SnapshotsActionsTest-786780460 None] Acquiring lock "cinder-quobyte-5cff40db-cb9b-423c-a98e-49bbcb224d13" by "_delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:53:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3ba9969b-ce8f-4427-b3f7-b0097f41ec99 tempest-VolumesCloneTest-953879006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.564s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:01 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-3ba9969b-ce8f-4427-b3f7-b0097f41ec99 tempest-VolumesCloneTest-953879006 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:53:01 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-3ba9969b-ce8f-4427-b3f7-b0097f41ec99 tempest-VolumesCloneTest-953879006 None] Deleted volume successfully. Apr 24 13:53:01 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-a1dd8cd2-f640-4fa0-8869-815ac8cd077e tempest-SnapshotsActionsTest-786780460 None] Lock "cinder-quobyte-5cff40db-cb9b-423c-a98e-49bbcb224d13" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:53:01 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-a1dd8cd2-f640-4fa0-8869-815ac8cd077e tempest-SnapshotsActionsTest-786780460 None] Deleting offline snapshot 5cff40db-cb9b-423c-a98e-49bbcb224d13 of volume 44a6110a-61e2-4992-af85-a51911520efd {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 13:53:01 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-a1dd8cd2-f640-4fa0-8869-815ac8cd077e tempest-SnapshotsActionsTest-786780460 None] snapshot_file for this snap is: volume-44a6110a-61e2-4992-af85-a51911520efd.5cff40db-cb9b-423c-a98e-49bbcb224d13 {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 13:53:01 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[aadf990a-338a-43be-93b1-77fd859ec1b6]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:53:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a1dd8cd2-f640-4fa0-8869-815ac8cd077e tempest-SnapshotsActionsTest-786780460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.5cff40db-cb9b-423c-a98e-49bbcb224d13 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:01 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-3ba9969b-ce8f-4427-b3f7-b0097f41ec99 tempest-VolumesCloneTest-953879006 None] Lock "cinder-ada72b41-9048-4462-80a5-ddae44a55396-delete_volume" released by "delete_volume" :: held 2.027s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:53:01 devstack sudo[88571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.5cff40db-cb9b-423c-a98e-49bbcb224d13 Apr 24 13:53:01 devstack sudo[88571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:01 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-0990d4a7-46ad-4ac8-8ade-8c573d2be587 tempest-VolumesCloneTest-953879006 None] Acquiring lock "cinder-4cd0e687-792a-4a73-9c15-8084ecfc186c-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:53:01 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-0990d4a7-46ad-4ac8-8ade-8c573d2be587 tempest-VolumesCloneTest-953879006 None] Lock "cinder-4cd0e687-792a-4a73-9c15-8084ecfc186c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:53:01 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-0990d4a7-46ad-4ac8-8ade-8c573d2be587 tempest-VolumesCloneTest-953879006 None] Acquiring lock "cinder-quobyte-4cd0e687-792a-4a73-9c15-8084ecfc186c" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:53:01 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-0990d4a7-46ad-4ac8-8ade-8c573d2be587 tempest-VolumesCloneTest-953879006 None] Lock "cinder-quobyte-4cd0e687-792a-4a73-9c15-8084ecfc186c" acquired by "delete_volume" :: waited 0.020s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:53:01 devstack sudo[88568]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b7d2197a-ff40-4664-8c68-f3a15fc87e99 tempest-VolumesSnapshotTestJSON-952003017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740 1073741824" returned: 0 in 0.870s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:01 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b6de77-60af-41c5-8268-36067e5a18a5]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:53:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0990d4a7-46ad-4ac8-8ade-8c573d2be587 tempest-VolumesCloneTest-953879006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b7d2197a-ff40-4664-8c68-f3a15fc87e99 tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:01 devstack sudo[88577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740 Apr 24 13:53:01 devstack sudo[88577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:01 devstack sudo[88576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c Apr 24 13:53:01 devstack sudo[88576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:02 devstack sudo[88571]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a1dd8cd2-f640-4fa0-8869-815ac8cd077e tempest-SnapshotsActionsTest-786780460 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.5cff40db-cb9b-423c-a98e-49bbcb224d13" returned: 0 in 0.741s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:02 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-a1dd8cd2-f640-4fa0-8869-815ac8cd077e tempest-SnapshotsActionsTest-786780460 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44a6110a-61e2-4992-af85-a51911520efd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:53:02 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[601cc792-f749-48b6-b0e1-0f9f2a7cb118]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:53:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a1dd8cd2-f640-4fa0-8869-815ac8cd077e tempest-SnapshotsActionsTest-786780460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:02 devstack sudo[88583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e Apr 24 13:53:02 devstack sudo[88583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:02 devstack sudo[88577]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b7d2197a-ff40-4664-8c68-f3a15fc87e99 tempest-VolumesSnapshotTestJSON-952003017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740" returned: 0 in 0.493s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:02 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b7d2197a-ff40-4664-8c68-f3a15fc87e99 tempest-VolumesSnapshotTestJSON-952003017 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:53:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b7d2197a-ff40-4664-8c68-f3a15fc87e99 tempest-VolumesSnapshotTestJSON-952003017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.420s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:53:02 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b7d2197a-ff40-4664-8c68-f3a15fc87e99 tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c729fd4-0dfd-4c84-ac81-a89adc2815ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7aecf75e-6c54-409f-b33a-5936d3370740', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:53:02 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b7d2197a-ff40-4664-8c68-f3a15fc87e99 tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2c0d725-acaf-4ece-b4a3-85b6ee631cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:53:02 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-b7d2197a-ff40-4664-8c68-f3a15fc87e99 tempest-VolumesSnapshotTestJSON-952003017 None] Volume volume-7aecf75e-6c54-409f-b33a-5936d3370740 (7aecf75e-6c54-409f-b33a-5936d3370740): created successfully Apr 24 13:53:02 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b7d2197a-ff40-4664-8c68-f3a15fc87e99 tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2c0d725-acaf-4ece-b4a3-85b6ee631cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:53:02 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b7d2197a-ff40-4664-8c68-f3a15fc87e99 tempest-VolumesSnapshotTestJSON-952003017 None] Flow 'volume_create_manager' (f7f53575-c7b4-4bb3-8a5b-7c69a70a6cfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:53:02 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-b7d2197a-ff40-4664-8c68-f3a15fc87e99 tempest-VolumesSnapshotTestJSON-952003017 None] Created volume successfully. Apr 24 13:53:02 devstack sudo[88576]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0990d4a7-46ad-4ac8-8ade-8c573d2be587 tempest-VolumesCloneTest-953879006 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c" returned: 0 in 0.616s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0990d4a7-46ad-4ac8-8ade-8c573d2be587 tempest-VolumesCloneTest-953879006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:02 devstack sudo[88589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c Apr 24 13:53:02 devstack sudo[88589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:02 devstack sudo[88583]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a1dd8cd2-f640-4fa0-8869-815ac8cd077e tempest-SnapshotsActionsTest-786780460 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e" returned: 0 in 0.605s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:02 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-a1dd8cd2-f640-4fa0-8869-815ac8cd077e tempest-SnapshotsActionsTest-786780460 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44a6110a-61e2-4992-af85-a51911520efd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:53:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a1dd8cd2-f640-4fa0-8869-815ac8cd077e tempest-SnapshotsActionsTest-786780460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.5cff40db-cb9b-423c-a98e-49bbcb224d13 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:02 devstack sudo[88594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.5cff40db-cb9b-423c-a98e-49bbcb224d13 Apr 24 13:53:02 devstack sudo[88594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:02 devstack sudo[88589]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0990d4a7-46ad-4ac8-8ade-8c573d2be587 tempest-VolumesCloneTest-953879006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4cd0e687-792a-4a73-9c15-8084ecfc186c" returned: 0 in 0.499s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:02 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-0990d4a7-46ad-4ac8-8ade-8c573d2be587 tempest-VolumesCloneTest-953879006 None] Lock "cinder-quobyte-4cd0e687-792a-4a73-9c15-8084ecfc186c" released by "delete_volume" :: held 1.186s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:53:03 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-0990d4a7-46ad-4ac8-8ade-8c573d2be587 tempest-VolumesCloneTest-953879006 None] Created reservations ['7170d404-5bba-4b4b-b693-e68389b02072', '2645b593-d661-43c5-a038-03f8676800ce', '6bea6206-1532-45d4-8922-a64ee2abe33e', 'fe73db22-5134-4e98-82ab-6d879cb649fe'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:53:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0990d4a7-46ad-4ac8-8ade-8c573d2be587 tempest-VolumesCloneTest-953879006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:53:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0990d4a7-46ad-4ac8-8ade-8c573d2be587 tempest-VolumesCloneTest-953879006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:53:03 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-0990d4a7-46ad-4ac8-8ade-8c573d2be587 tempest-VolumesCloneTest-953879006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:53:03 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-0990d4a7-46ad-4ac8-8ade-8c573d2be587 tempest-VolumesCloneTest-953879006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:53:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0990d4a7-46ad-4ac8-8ade-8c573d2be587 tempest-VolumesCloneTest-953879006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:53:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0990d4a7-46ad-4ac8-8ade-8c573d2be587 tempest-VolumesCloneTest-953879006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:03 devstack sudo[88597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:53:03 devstack sudo[88597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a0ae08b0-13c8-4709-a922-bb60b48917d7 tempest-VolumesSnapshotTestJSON-952003017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:53:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a0ae08b0-13c8-4709-a922-bb60b48917d7 tempest-VolumesSnapshotTestJSON-952003017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:53:03 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-a0ae08b0-13c8-4709-a922-bb60b48917d7 tempest-VolumesSnapshotTestJSON-952003017 None] Creating offline snapshot 0789457d-414f-4c5b-867a-bd0b8b270312 of volume 7aecf75e-6c54-409f-b33a-5936d3370740 {{(pid=82046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 13:53:03 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a0ec45-da65-4b8f-9deb-b746a112c7e4]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:53:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a0ae08b0-13c8-4709-a922-bb60b48917d7 tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:03 devstack sudo[88602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740 Apr 24 13:53:03 devstack sudo[88602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:03 devstack sudo[88594]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a1dd8cd2-f640-4fa0-8869-815ac8cd077e tempest-SnapshotsActionsTest-786780460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.5cff40db-cb9b-423c-a98e-49bbcb224d13" returned: 0 in 0.753s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a1dd8cd2-f640-4fa0-8869-815ac8cd077e tempest-SnapshotsActionsTest-786780460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.5cff40db-cb9b-423c-a98e-49bbcb224d13 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:03 devstack sudo[88604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.5cff40db-cb9b-423c-a98e-49bbcb224d13 Apr 24 13:53:03 devstack sudo[88604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:03 devstack sudo[88597]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0990d4a7-46ad-4ac8-8ade-8c573d2be587 tempest-VolumesCloneTest-953879006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.560s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:03 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-0990d4a7-46ad-4ac8-8ade-8c573d2be587 tempest-VolumesCloneTest-953879006 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:53:03 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-0990d4a7-46ad-4ac8-8ade-8c573d2be587 tempest-VolumesCloneTest-953879006 None] Deleted volume successfully. Apr 24 13:53:03 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-0990d4a7-46ad-4ac8-8ade-8c573d2be587 tempest-VolumesCloneTest-953879006 None] Lock "cinder-4cd0e687-792a-4a73-9c15-8084ecfc186c-delete_volume" released by "delete_volume" :: held 2.070s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:53:03 devstack sudo[88602]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a0ae08b0-13c8-4709-a922-bb60b48917d7 tempest-VolumesSnapshotTestJSON-952003017 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740" returned: 0 in 0.706s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a0ae08b0-13c8-4709-a922-bb60b48917d7 tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740.0789457d-414f-4c5b-867a-bd0b8b270312 1G {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:03 devstack sudo[88611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740.0789457d-414f-4c5b-867a-bd0b8b270312 1G Apr 24 13:53:03 devstack sudo[88611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:04 devstack sudo[88604]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:04 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a1dd8cd2-f640-4fa0-8869-815ac8cd077e tempest-SnapshotsActionsTest-786780460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.5cff40db-cb9b-423c-a98e-49bbcb224d13" returned: 0 in 0.549s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:04 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-a1dd8cd2-f640-4fa0-8869-815ac8cd077e tempest-SnapshotsActionsTest-786780460 None] Lock "cinder-quobyte-5cff40db-cb9b-423c-a98e-49bbcb224d13" released by "_delete_snapshot" :: held 2.755s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:53:04 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-a1dd8cd2-f640-4fa0-8869-815ac8cd077e tempest-SnapshotsActionsTest-786780460 None] Lock "cinder-quobyte-44a6110a-61e2-4992-af85-a51911520efd" released by "delete_snapshot" :: held 2.796s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:53:04 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-a1dd8cd2-f640-4fa0-8869-815ac8cd077e tempest-SnapshotsActionsTest-786780460 None] Created reservations ['770a9e09-2f0c-49a5-ad18-e701d9204d26', 'f0a97952-25ea-424f-ac91-ac835cbf978e', '5e5114ab-6ed6-454c-8566-adf9ca2bf656', 'c01e3799-fc2c-4d42-8032-8557226324d9'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:53:04 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-a1dd8cd2-f640-4fa0-8869-815ac8cd077e tempest-SnapshotsActionsTest-786780460 None] Delete snapshot completed successfully. Apr 24 13:53:04 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-a1dd8cd2-f640-4fa0-8869-815ac8cd077e tempest-SnapshotsActionsTest-786780460 None] Lock "cinder-5cff40db-cb9b-423c-a98e-49bbcb224d13-delete_snapshot" released by "delete_snapshot" :: held 3.001s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:53:04 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5ebaae06-59f4-4cf7-b77c-e527c2a66ce9 tempest-SnapshotsActionsTest-323206228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:53:04 devstack sudo[88611]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:04 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a0ae08b0-13c8-4709-a922-bb60b48917d7 tempest-VolumesSnapshotTestJSON-952003017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740.0789457d-414f-4c5b-867a-bd0b8b270312 1G" returned: 0 in 0.953s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:04 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a0ae08b0-13c8-4709-a922-bb60b48917d7 tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7aecf75e-6c54-409f-b33a-5936d3370740 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740.0789457d-414f-4c5b-867a-bd0b8b270312 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:04 devstack sudo[88616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7aecf75e-6c54-409f-b33a-5936d3370740 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740.0789457d-414f-4c5b-867a-bd0b8b270312 Apr 24 13:53:04 devstack sudo[88616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:05 devstack sudo[88616]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:05 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a0ae08b0-13c8-4709-a922-bb60b48917d7 tempest-VolumesSnapshotTestJSON-952003017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7aecf75e-6c54-409f-b33a-5936d3370740 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740.0789457d-414f-4c5b-867a-bd0b8b270312" returned: 0 in 0.681s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:05 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-a0ae08b0-13c8-4709-a922-bb60b48917d7 tempest-VolumesSnapshotTestJSON-952003017 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740.0789457d-414f-4c5b-867a-bd0b8b270312 is being set with open permissions: ugo+rw Apr 24 13:53:05 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a0ae08b0-13c8-4709-a922-bb60b48917d7 tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740.0789457d-414f-4c5b-867a-bd0b8b270312 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:05 devstack sudo[88623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740.0789457d-414f-4c5b-867a-bd0b8b270312 Apr 24 13:53:05 devstack sudo[88623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:06 devstack sudo[88623]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a0ae08b0-13c8-4709-a922-bb60b48917d7 tempest-VolumesSnapshotTestJSON-952003017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740.0789457d-414f-4c5b-867a-bd0b8b270312" returned: 0 in 0.496s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a0ae08b0-13c8-4709-a922-bb60b48917d7 tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:06 devstack sudo[88626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740.info Apr 24 13:53:06 devstack sudo[88626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:06 devstack sudo[88626]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a0ae08b0-13c8-4709-a922-bb60b48917d7 tempest-VolumesSnapshotTestJSON-952003017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740.info" returned: 0 in 0.531s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:06 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-a0ae08b0-13c8-4709-a922-bb60b48917d7 tempest-VolumesSnapshotTestJSON-952003017 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740.info is being set with open permissions: ugo+rw Apr 24 13:53:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a0ae08b0-13c8-4709-a922-bb60b48917d7 tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:06 devstack sudo[88629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740.info Apr 24 13:53:06 devstack sudo[88629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:07 devstack sudo[88629]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a0ae08b0-13c8-4709-a922-bb60b48917d7 tempest-VolumesSnapshotTestJSON-952003017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740.info" returned: 0 in 0.484s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a0ae08b0-13c8-4709-a922-bb60b48917d7 tempest-VolumesSnapshotTestJSON-952003017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.953s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:53:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5ebaae06-59f4-4cf7-b77c-e527c2a66ce9 tempest-SnapshotsActionsTest-323206228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.284s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:53:07 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-5ebaae06-59f4-4cf7-b77c-e527c2a66ce9 tempest-SnapshotsActionsTest-323206228 None] Creating offline snapshot 4aafa583-5062-4e8b-94eb-c889e5657a6a of volume 44a6110a-61e2-4992-af85-a51911520efd {{(pid=82046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 13:53:07 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-a0ae08b0-13c8-4709-a922-bb60b48917d7 tempest-VolumesSnapshotTestJSON-952003017 None] Create snapshot completed successfully Apr 24 13:53:07 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[1417c14b-a409-4277-aa2c-f6a2e8c78ad5]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:53:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ebaae06-59f4-4cf7-b77c-e527c2a66ce9 tempest-SnapshotsActionsTest-323206228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:07 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:53:07 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] Flow 'volume_create_manager' (1fc2f02d-913f-44ae-8639-ee7de2c57437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:53:07 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72892674-a3d6-4054-a0d2-b035f73eb694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:53:07 devstack sudo[88632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e Apr 24 13:53:07 devstack sudo[88632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:07 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72892674-a3d6-4054-a0d2-b035f73eb694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:53:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-100946991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34c90930-4c73-40bf-89fd-204c6f4507ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0344dc0e505545448d8a4f3eb4fd7ed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:53:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:53:07Z,use_quota=True,user_id='742e78f68a264ddc99cf0d1ac442ae21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:53:07 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6cf5621-a050-448e-bfd6-81cbe189fc65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:53:07 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6cf5621-a050-448e-bfd6-81cbe189fc65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:53:07 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b6f5389-abc6-4882-9b73-deafe847338c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:53:07 devstack cinder-volume[82046]: DEBUG cinder.image.glance [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] Creating Keystone auth plugin from conf {{(pid=82046) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 24 13:53:07 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b6f5389-abc6-4882-9b73-deafe847338c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '34c90930-4c73-40bf-89fd-204c6f4507ba', 'volume_name': 'volume-34c90930-4c73-40bf-89fd-204c6f4507ba', 'volume_size': 1, 'image_id': '02b8aec0-dc1c-4b93-81c4-ab6b88d472d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02b8aec0-dc1c-4b93-81c4-ab6b88d472d9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db6d5b1c41254596bd8bad1e5f7bec28', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02b8aec0-dc1c-4b93-81c4-ab6b88d472d9', 'created_at': datetime.datetime(2026, 4, 24, 11, 39, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 11, 39, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02b8aec0-dc1c-4b93-81c4-ab6b88d472d9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:53:07 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66eba219-8c70-4717-94d9-967efbf49254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:53:07 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66eba219-8c70-4717-94d9-967efbf49254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:53:07 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (973a6933-e01d-4136-b8c1-693fa0c7aa77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:53:07 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] Volume 34c90930-4c73-40bf-89fd-204c6f4507ba: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-34c90930-4c73-40bf-89fd-204c6f4507ba', 'volume_size': 1, 'image_id': '02b8aec0-dc1c-4b93-81c4-ab6b88d472d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02b8aec0-dc1c-4b93-81c4-ab6b88d472d9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db6d5b1c41254596bd8bad1e5f7bec28', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02b8aec0-dc1c-4b93-81c4-ab6b88d472d9', 'created_at': datetime.datetime(2026, 4, 24, 11, 39, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 11, 39, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02b8aec0-dc1c-4b93-81c4-ab6b88d472d9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 24 13:53:07 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] Trying to clone 34c90930-4c73-40bf-89fd-204c6f4507ba from image 02b8aec0-dc1c-4b93-81c4-ab6b88d472d9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/02b8aec0-dc1c-4b93-81c4-ab6b88d472d9', 'metadata': {}}]). {{(pid=82046) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 24 13:53:07 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:53:07 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] Flow 'volume_create_manager' (5cd23333-d6b7-496b-9ffe-5d01fca53936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:53:07 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ea34901-2ea3-4884-b624-985bf0b9b685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:53:07 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ea34901-2ea3-4884-b624-985bf0b9b685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1358744217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a63b1a2-ff77-473f-9f84-e3bce1619685,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81778cce064e41cca9db08dd8c34436d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:53:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=0789457d-414f-4c5b-867a-bd0b8b270312,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:53:08Z,use_quota=True,user_id='828592763a7247db9e1ebd1796caa21e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:53:07 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a3f1148-3155-4d0f-b39c-02f28b4d35d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:53:07 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a3f1148-3155-4d0f-b39c-02f28b4d35d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:53:07 devstack sudo[88632]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:07 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d23fb2cc-8c51-4b2d-a6a9-d04607d4aec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:53:07 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d23fb2cc-8c51-4b2d-a6a9-d04607d4aec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0a63b1a2-ff77-473f-9f84-e3bce1619685', 'volume_name': 'volume-0a63b1a2-ff77-473f-9f84-e3bce1619685', 'volume_size': 2, 'snapshot_id': '0789457d-414f-4c5b-867a-bd0b8b270312'}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:53:07 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a87815a9-7163-4025-9d6c-21e4bfd50f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:53:07 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a87815a9-7163-4025-9d6c-21e4bfd50f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:53:07 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47539c0b-bf51-4b43-b6f3-9a65e509170d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:53:07 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] Volume 0a63b1a2-ff77-473f-9f84-e3bce1619685: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0a63b1a2-ff77-473f-9f84-e3bce1619685', 'volume_size': 2, 'snapshot_id': '0789457d-414f-4c5b-867a-bd0b8b270312'} Apr 24 13:53:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ebaae06-59f4-4cf7-b77c-e527c2a66ce9 tempest-SnapshotsActionsTest-323206228 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e" returned: 0 in 0.753s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:08 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-5ebaae06-59f4-4cf7-b77c-e527c2a66ce9 tempest-SnapshotsActionsTest-323206228 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44a6110a-61e2-4992-af85-a51911520efd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:53:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ebaae06-59f4-4cf7-b77c-e527c2a66ce9 tempest-SnapshotsActionsTest-323206228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.4aafa583-5062-4e8b-94eb-c889e5657a6a 1G {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:53:08 devstack sudo[88637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.4aafa583-5062-4e8b-94eb-c889e5657a6a 1G Apr 24 13:53:08 devstack sudo[88637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:08 devstack cinder-volume[82046]: DEBUG cinder.image.image_utils [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_e2yz6bzcdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82046) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 24 13:53:08 devstack cinder-volume[82046]: INFO cinder.image.image_utils [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] Image download 20.69 MB at 20.69 MB/s Apr 24 13:53:08 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6763635-f2a3-41d4-b107-b5da05f48853]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:53:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_e2yz6bzcdevstack@QuobyteHD {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:08 devstack sudo[88640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_e2yz6bzcdevstack@QuobyteHD Apr 24 13:53:08 devstack sudo[88640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:08 devstack sudo[88637]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ebaae06-59f4-4cf7-b77c-e527c2a66ce9 tempest-SnapshotsActionsTest-323206228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.4aafa583-5062-4e8b-94eb-c889e5657a6a 1G" returned: 0 in 0.766s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ebaae06-59f4-4cf7-b77c-e527c2a66ce9 tempest-SnapshotsActionsTest-323206228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.4aafa583-5062-4e8b-94eb-c889e5657a6a {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:08 devstack sudo[88648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.4aafa583-5062-4e8b-94eb-c889e5657a6a Apr 24 13:53:08 devstack sudo[88648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:08 devstack sudo[88640]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_e2yz6bzcdevstack@QuobyteHD" returned: 0 in 0.622s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:08 devstack cinder-volume[82046]: DEBUG cinder.image.image_utils [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] Temporary image 02b8aec0-dc1c-4b93-81c4-ab6b88d472d9 is fetched for user 742e78f68a264ddc99cf0d1ac442ae21. {{(pid=82046) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 24 13:53:08 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[779c25bb-e5a3-45db-973d-154cf6a90040]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:53:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_e2yz6bzcdevstack@QuobyteHD {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:08 devstack sudo[88650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_e2yz6bzcdevstack@QuobyteHD Apr 24 13:53:08 devstack sudo[88650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:09 devstack sudo[88648]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ebaae06-59f4-4cf7-b77c-e527c2a66ce9 tempest-SnapshotsActionsTest-323206228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.4aafa583-5062-4e8b-94eb-c889e5657a6a" returned: 0 in 0.514s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:09 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-5ebaae06-59f4-4cf7-b77c-e527c2a66ce9 tempest-SnapshotsActionsTest-323206228 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.4aafa583-5062-4e8b-94eb-c889e5657a6a is being set with open permissions: ugo+rw Apr 24 13:53:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ebaae06-59f4-4cf7-b77c-e527c2a66ce9 tempest-SnapshotsActionsTest-323206228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.4aafa583-5062-4e8b-94eb-c889e5657a6a {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:09 devstack sudo[88655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.4aafa583-5062-4e8b-94eb-c889e5657a6a Apr 24 13:53:09 devstack sudo[88655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:09 devstack sudo[88650]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_e2yz6bzcdevstack@QuobyteHD" returned: 0 in 0.564s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:53:09 devstack sudo[88655]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ebaae06-59f4-4cf7-b77c-e527c2a66ce9 tempest-SnapshotsActionsTest-323206228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.4aafa583-5062-4e8b-94eb-c889e5657a6a" returned: 0 in 0.475s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5ebaae06-59f4-4cf7-b77c-e527c2a66ce9 tempest-SnapshotsActionsTest-323206228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.650s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:53:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.784s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:53:09 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] Acquiring lock "cinder-quobyte-0789457d-414f-4c5b-867a-bd0b8b270312-0a63b1a2-ff77-473f-9f84-e3bce1619685" by "_create_volume_from_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:53:09 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] Lock "cinder-quobyte-0789457d-414f-4c5b-867a-bd0b8b270312-0a63b1a2-ff77-473f-9f84-e3bce1619685" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:53:09 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] Creating volume 0a63b1a2-ff77-473f-9f84-e3bce1619685 from snapshot 0789457d-414f-4c5b-867a-bd0b8b270312 {{(pid=82046) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 13:53:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:53:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:53:09 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:53:09 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:53:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:53:09 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:53:09 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] Acquiring lock "cinder-quobyte-0a63b1a2-ff77-473f-9f84-e3bce1619685" by "_copy_volume_from_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:53:09 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-5ebaae06-59f4-4cf7-b77c-e527c2a66ce9 tempest-SnapshotsActionsTest-323206228 None] Create snapshot completed successfully Apr 24 13:53:09 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] Lock "cinder-quobyte-0a63b1a2-ff77-473f-9f84-e3bce1619685" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:53:09 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] snapshot: 0789457d-414f-4c5b-867a-bd0b8b270312, volume: 0a63b1a2-ff77-473f-9f84-e3bce1619685, {{(pid=82046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 13:53:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:53:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:53:09 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:53:09 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:53:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:53:09 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3a3e85-948c-4647-91cb-4680064a7869]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:53:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740.0789457d-414f-4c5b-867a-bd0b8b270312 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:10 devstack sudo[88661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740.0789457d-414f-4c5b-867a-bd0b8b270312 Apr 24 13:53:10 devstack sudo[88661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:10 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-00cfbebf-d7c3-425d-b6f2-6585e757f18e tempest-SnapshotsActionsTest-786780460 None] Acquiring lock "cinder-4aafa583-5062-4e8b-94eb-c889e5657a6a-delete_snapshot" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:53:10 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-00cfbebf-d7c3-425d-b6f2-6585e757f18e tempest-SnapshotsActionsTest-786780460 None] Lock "cinder-4aafa583-5062-4e8b-94eb-c889e5657a6a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:53:10 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-00cfbebf-d7c3-425d-b6f2-6585e757f18e tempest-SnapshotsActionsTest-786780460 None] Acquiring lock "cinder-quobyte-44a6110a-61e2-4992-af85-a51911520efd" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:53:10 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-00cfbebf-d7c3-425d-b6f2-6585e757f18e tempest-SnapshotsActionsTest-786780460 None] Lock "cinder-quobyte-44a6110a-61e2-4992-af85-a51911520efd" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:53:10 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-00cfbebf-d7c3-425d-b6f2-6585e757f18e tempest-SnapshotsActionsTest-786780460 None] Acquiring lock "cinder-quobyte-4aafa583-5062-4e8b-94eb-c889e5657a6a" by "_delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:53:10 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-00cfbebf-d7c3-425d-b6f2-6585e757f18e tempest-SnapshotsActionsTest-786780460 None] Lock "cinder-quobyte-4aafa583-5062-4e8b-94eb-c889e5657a6a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:53:10 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-00cfbebf-d7c3-425d-b6f2-6585e757f18e tempest-SnapshotsActionsTest-786780460 None] Deleting offline snapshot 4aafa583-5062-4e8b-94eb-c889e5657a6a of volume 44a6110a-61e2-4992-af85-a51911520efd {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 13:53:10 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-00cfbebf-d7c3-425d-b6f2-6585e757f18e tempest-SnapshotsActionsTest-786780460 None] snapshot_file for this snap is: volume-44a6110a-61e2-4992-af85-a51911520efd.4aafa583-5062-4e8b-94eb-c889e5657a6a {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 13:53:10 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3057f3d-a4a1-4941-b9ab-57f24368bc62]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:53:10 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-00cfbebf-d7c3-425d-b6f2-6585e757f18e tempest-SnapshotsActionsTest-786780460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.4aafa583-5062-4e8b-94eb-c889e5657a6a {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:10 devstack sudo[88663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.4aafa583-5062-4e8b-94eb-c889e5657a6a Apr 24 13:53:10 devstack sudo[88663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:10 devstack sudo[88661]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:10 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740.0789457d-414f-4c5b-867a-bd0b8b270312" returned: 0 in 0.601s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:10 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7aecf75e-6c54-409f-b33a-5936d3370740(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:53:10 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740 {{(pid=82046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 13:53:10 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] Creating direct copy from snapshot {{(pid=82046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 13:53:10 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b0235e-61b7-482b-8258-716839b3ecf3]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:53:10 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:10 devstack sudo[88668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740 Apr 24 13:53:10 devstack sudo[88668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:10 devstack sudo[88663]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:10 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-00cfbebf-d7c3-425d-b6f2-6585e757f18e tempest-SnapshotsActionsTest-786780460 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.4aafa583-5062-4e8b-94eb-c889e5657a6a" returned: 0 in 0.588s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:10 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-00cfbebf-d7c3-425d-b6f2-6585e757f18e tempest-SnapshotsActionsTest-786780460 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44a6110a-61e2-4992-af85-a51911520efd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:53:10 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa549e0-2302-4f41-ad90-368f8aa527b2]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:53:10 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-00cfbebf-d7c3-425d-b6f2-6585e757f18e tempest-SnapshotsActionsTest-786780460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:11 devstack sudo[88673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e Apr 24 13:53:11 devstack sudo[88673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:11 devstack sudo[88668]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740" returned: 0 in 0.638s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:11 devstack cinder-volume[82046]: DEBUG cinder.utils [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] Path /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0a63b1a2-ff77-473f-9f84-e3bce1619685 not found in is_blk_device check {{(pid=82046) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 13:53:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0a63b1a2-ff77-473f-9f84-e3bce1619685 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:11 devstack sudo[88678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0a63b1a2-ff77-473f-9f84-e3bce1619685 Apr 24 13:53:11 devstack sudo[88678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:11 devstack sudo[88673]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-00cfbebf-d7c3-425d-b6f2-6585e757f18e tempest-SnapshotsActionsTest-786780460 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e" returned: 0 in 0.607s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:11 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-00cfbebf-d7c3-425d-b6f2-6585e757f18e tempest-SnapshotsActionsTest-786780460 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44a6110a-61e2-4992-af85-a51911520efd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:53:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-00cfbebf-d7c3-425d-b6f2-6585e757f18e tempest-SnapshotsActionsTest-786780460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.4aafa583-5062-4e8b-94eb-c889e5657a6a {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:11 devstack sudo[88683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.4aafa583-5062-4e8b-94eb-c889e5657a6a Apr 24 13:53:11 devstack sudo[88683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:12 devstack sudo[88683]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-00cfbebf-d7c3-425d-b6f2-6585e757f18e tempest-SnapshotsActionsTest-786780460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.4aafa583-5062-4e8b-94eb-c889e5657a6a" returned: 0 in 1.091s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-00cfbebf-d7c3-425d-b6f2-6585e757f18e tempest-SnapshotsActionsTest-786780460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.4aafa583-5062-4e8b-94eb-c889e5657a6a {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:12 devstack sudo[88698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.4aafa583-5062-4e8b-94eb-c889e5657a6a Apr 24 13:53:12 devstack sudo[88698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:13 devstack sudo[88698]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-00cfbebf-d7c3-425d-b6f2-6585e757f18e tempest-SnapshotsActionsTest-786780460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.4aafa583-5062-4e8b-94eb-c889e5657a6a" returned: 0 in 0.788s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:13 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-00cfbebf-d7c3-425d-b6f2-6585e757f18e tempest-SnapshotsActionsTest-786780460 None] Lock "cinder-quobyte-4aafa583-5062-4e8b-94eb-c889e5657a6a" released by "_delete_snapshot" :: held 3.210s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:53:13 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-00cfbebf-d7c3-425d-b6f2-6585e757f18e tempest-SnapshotsActionsTest-786780460 None] Lock "cinder-quobyte-44a6110a-61e2-4992-af85-a51911520efd" released by "delete_snapshot" :: held 3.239s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:53:13 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-00cfbebf-d7c3-425d-b6f2-6585e757f18e tempest-SnapshotsActionsTest-786780460 None] Created reservations ['cb359bbf-3be1-4efc-9ebf-e4a38f8479cd', '937bf1d6-d957-439f-aad9-c0814d027ee5', '5397b1e4-ec1a-4162-a3a6-3f909dbd1554', '1e2ab379-6534-4f11-a3bf-e4e55b9b67c0'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:53:13 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-00cfbebf-d7c3-425d-b6f2-6585e757f18e tempest-SnapshotsActionsTest-786780460 None] Delete snapshot completed successfully. Apr 24 13:53:13 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-00cfbebf-d7c3-425d-b6f2-6585e757f18e tempest-SnapshotsActionsTest-786780460 None] Lock "cinder-4aafa583-5062-4e8b-94eb-c889e5657a6a-delete_snapshot" released by "delete_snapshot" :: held 3.528s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:53:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-6309a647-99b0-42f2-849b-1dbf6535efb2 tempest-SnapshotsActionsTest-323206228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:53:16 devstack sudo[88678]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:16 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0a63b1a2-ff77-473f-9f84-e3bce1619685" returned: 0 in 5.246s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:16 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[df07d2f1-dee0-4568-9f36-9ac2c1ba7d68]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:53:16 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:16 devstack sudo[88702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740 Apr 24 13:53:16 devstack sudo[88702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:17 devstack sudo[88702]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740" returned: 0 in 0.711s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:17 devstack cinder-volume[82046]: DEBUG cinder.image.image_utils [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] Image conversion details: src /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740, size 1024.00 MB, duration 5.25 sec, destination /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0a63b1a2-ff77-473f-9f84-e3bce1619685 {{(pid=82046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 13:53:17 devstack cinder-volume[82046]: INFO cinder.image.image_utils [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] Converted 1024.00 MB image at 195.14 MB/s Apr 24 13:53:17 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0a63b1a2-ff77-473f-9f84-e3bce1619685 is being set with open permissions: ugo+rw Apr 24 13:53:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0a63b1a2-ff77-473f-9f84-e3bce1619685 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:17 devstack sudo[88739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0a63b1a2-ff77-473f-9f84-e3bce1619685 Apr 24 13:53:17 devstack sudo[88739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:17 devstack sudo[88739]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0a63b1a2-ff77-473f-9f84-e3bce1619685" returned: 0 in 0.482s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:17 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] Lock "cinder-quobyte-0a63b1a2-ff77-473f-9f84-e3bce1619685" released by "_copy_volume_from_snapshot" :: held 7.773s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:53:17 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] Lock "cinder-quobyte-0789457d-414f-4c5b-867a-bd0b8b270312-0a63b1a2-ff77-473f-9f84-e3bce1619685" released by "_create_volume_from_snapshot" :: held 7.820s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:53:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.859s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:53:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.215s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:53:17 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:53:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-100946991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34c90930-4c73-40bf-89fd-204c6f4507ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0344dc0e505545448d8a4f3eb4fd7ed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:53:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:53:07Z,use_quota=True,user_id='742e78f68a264ddc99cf0d1ac442ae21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:53:17 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] Creating volume 34c90930-4c73-40bf-89fd-204c6f4507ba {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:53:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:53:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:53:17 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:53:17 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:53:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:53:17 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:53:17 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:53:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-34c90930-4c73-40bf-89fd-204c6f4507ba 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:17 devstack sudo[88744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-34c90930-4c73-40bf-89fd-204c6f4507ba 1073741824 Apr 24 13:53:17 devstack sudo[88744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:17 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47539c0b-bf51-4b43-b6f3-9a65e509170d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a63b1a2-ff77-473f-9f84-e3bce1619685', 'volume_size': 2, 'snapshot_id': '0789457d-414f-4c5b-867a-bd0b8b270312'}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:53:17 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5decf0b2-9f06-493d-bf8e-165201190a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:53:17 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] Volume volume-0a63b1a2-ff77-473f-9f84-e3bce1619685 (0a63b1a2-ff77-473f-9f84-e3bce1619685): created successfully Apr 24 13:53:17 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5decf0b2-9f06-493d-bf8e-165201190a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:53:17 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] Flow 'volume_create_manager' (5cd23333-d6b7-496b-9ffe-5d01fca53936) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:53:17 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-0b32c2df-1b52-4780-9499-828123c5b8c0 tempest-VolumesSnapshotTestJSON-952003017 None] Created volume successfully. Apr 24 13:53:18 devstack sudo[88744]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:18 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-34c90930-4c73-40bf-89fd-204c6f4507ba 1073741824" returned: 0 in 0.667s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:18 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-34c90930-4c73-40bf-89fd-204c6f4507ba {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:18 devstack sudo[88749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-34c90930-4c73-40bf-89fd-204c6f4507ba Apr 24 13:53:18 devstack sudo[88749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:18 devstack sudo[88749]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:18 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-34c90930-4c73-40bf-89fd-204c6f4507ba" returned: 0 in 0.502s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:18 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] <== create_volume: return (1229ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:53:18 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.232s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:53:18 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-6309a647-99b0-42f2-849b-1dbf6535efb2 tempest-SnapshotsActionsTest-323206228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.630s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:53:18 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-6309a647-99b0-42f2-849b-1dbf6535efb2 tempest-SnapshotsActionsTest-323206228 None] Creating offline snapshot bcc9f7de-5b82-458b-b650-fb13f162ae0d of volume 44a6110a-61e2-4992-af85-a51911520efd {{(pid=82046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 13:53:18 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-668a0811-2ce5-42a2-8409-e7dc8df1bc7e tempest-VolumesSnapshotTestJSON-952003017 None] Acquiring lock "cinder-0a63b1a2-ff77-473f-9f84-e3bce1619685-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:53:18 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[635fc485-56c0-463a-80ad-a5e9e7f45849]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:53:18 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6309a647-99b0-42f2-849b-1dbf6535efb2 tempest-SnapshotsActionsTest-323206228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:19 devstack cinder-volume[82046]: DEBUG cinder.volume.volume_utils [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] Attempting download of 02b8aec0-dc1c-4b93-81c4-ab6b88d472d9 ((None, [{'url': 'file:///opt/stack/data/glance/images/02b8aec0-dc1c-4b93-81c4-ab6b88d472d9', 'metadata': {}}])) to volume 34c90930-4c73-40bf-89fd-204c6f4507ba. {{(pid=82046) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 24 13:53:19 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-668a0811-2ce5-42a2-8409-e7dc8df1bc7e tempest-VolumesSnapshotTestJSON-952003017 None] Lock "cinder-0a63b1a2-ff77-473f-9f84-e3bce1619685-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:53:19 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c36f422-1dc2-4e65-a074-6e9f2613390c]: (4, 'raw') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:53:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_8j_pg5kv {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:19 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-668a0811-2ce5-42a2-8409-e7dc8df1bc7e tempest-VolumesSnapshotTestJSON-952003017 None] Acquiring lock "cinder-quobyte-0a63b1a2-ff77-473f-9f84-e3bce1619685" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:53:19 devstack sudo[88752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e Apr 24 13:53:19 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-668a0811-2ce5-42a2-8409-e7dc8df1bc7e tempest-VolumesSnapshotTestJSON-952003017 None] Lock "cinder-quobyte-0a63b1a2-ff77-473f-9f84-e3bce1619685" acquired by "delete_volume" :: waited 0.018s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:53:19 devstack sudo[88752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:19 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[780e55e7-b8e9-4a52-8965-36407bbbe678]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:53:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-668a0811-2ce5-42a2-8409-e7dc8df1bc7e tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0a63b1a2-ff77-473f-9f84-e3bce1619685 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:19 devstack sudo[88753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_8j_pg5kv Apr 24 13:53:19 devstack sudo[88753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:19 devstack sudo[88755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0a63b1a2-ff77-473f-9f84-e3bce1619685 Apr 24 13:53:19 devstack sudo[88755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:19 devstack sudo[88752]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:19 devstack sudo[88753]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6309a647-99b0-42f2-849b-1dbf6535efb2 tempest-SnapshotsActionsTest-323206228 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e" returned: 0 in 0.656s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:19 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-6309a647-99b0-42f2-849b-1dbf6535efb2 tempest-SnapshotsActionsTest-323206228 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44a6110a-61e2-4992-af85-a51911520efd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:53:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6309a647-99b0-42f2-849b-1dbf6535efb2 tempest-SnapshotsActionsTest-323206228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.bcc9f7de-5b82-458b-b650-fb13f162ae0d 1G {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_8j_pg5kv" returned: 0 in 0.588s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_8j_pg5kv {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:19 devstack sudo[88766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.bcc9f7de-5b82-458b-b650-fb13f162ae0d 1G Apr 24 13:53:19 devstack sudo[88766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:19 devstack sudo[88767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_8j_pg5kv Apr 24 13:53:19 devstack sudo[88767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:19 devstack sudo[88755]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-668a0811-2ce5-42a2-8409-e7dc8df1bc7e tempest-VolumesSnapshotTestJSON-952003017 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0a63b1a2-ff77-473f-9f84-e3bce1619685" returned: 0 in 0.634s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-668a0811-2ce5-42a2-8409-e7dc8df1bc7e tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0a63b1a2-ff77-473f-9f84-e3bce1619685 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:19 devstack sudo[88770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0a63b1a2-ff77-473f-9f84-e3bce1619685 Apr 24 13:53:19 devstack sudo[88770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:20 devstack sudo[88767]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_8j_pg5kv" returned: 1 in 0.637s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_8j_pg5kv' failed. Not Retrying. {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 13:53:20 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[1263c951-d175-4f40-bae8-320c08f8fd47]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:53:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_e2yz6bzcdevstack@QuobyteHD {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:20 devstack sudo[88770]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-668a0811-2ce5-42a2-8409-e7dc8df1bc7e tempest-VolumesSnapshotTestJSON-952003017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0a63b1a2-ff77-473f-9f84-e3bce1619685" returned: 0 in 0.588s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:20 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-668a0811-2ce5-42a2-8409-e7dc8df1bc7e tempest-VolumesSnapshotTestJSON-952003017 None] Lock "cinder-quobyte-0a63b1a2-ff77-473f-9f84-e3bce1619685" released by "delete_volume" :: held 1.265s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:53:20 devstack sudo[88778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_e2yz6bzcdevstack@QuobyteHD Apr 24 13:53:20 devstack sudo[88778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:20 devstack sudo[88766]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6309a647-99b0-42f2-849b-1dbf6535efb2 tempest-SnapshotsActionsTest-323206228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.bcc9f7de-5b82-458b-b650-fb13f162ae0d 1G" returned: 0 in 0.801s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6309a647-99b0-42f2-849b-1dbf6535efb2 tempest-SnapshotsActionsTest-323206228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.bcc9f7de-5b82-458b-b650-fb13f162ae0d {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:20 devstack sudo[88780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.bcc9f7de-5b82-458b-b650-fb13f162ae0d Apr 24 13:53:20 devstack sudo[88780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:20 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-668a0811-2ce5-42a2-8409-e7dc8df1bc7e tempest-VolumesSnapshotTestJSON-952003017 None] Created reservations ['7c4091d6-1aef-4857-abc9-d8b86126f722', '10785dd8-cfe1-4777-bb0b-757cc48c7af9', 'f0f5803f-5709-4987-a5a0-c816b0c6b4e3', 'ffafb6ad-f31e-40ee-9339-d7c94d703905'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:53:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-668a0811-2ce5-42a2-8409-e7dc8df1bc7e tempest-VolumesSnapshotTestJSON-952003017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:53:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-668a0811-2ce5-42a2-8409-e7dc8df1bc7e tempest-VolumesSnapshotTestJSON-952003017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:53:20 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-668a0811-2ce5-42a2-8409-e7dc8df1bc7e tempest-VolumesSnapshotTestJSON-952003017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:53:20 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-668a0811-2ce5-42a2-8409-e7dc8df1bc7e tempest-VolumesSnapshotTestJSON-952003017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:53:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-668a0811-2ce5-42a2-8409-e7dc8df1bc7e tempest-VolumesSnapshotTestJSON-952003017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:53:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-668a0811-2ce5-42a2-8409-e7dc8df1bc7e tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:20 devstack sudo[88782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:53:20 devstack sudo[88782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:20 devstack sudo[88778]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_e2yz6bzcdevstack@QuobyteHD" returned: 0 in 0.576s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:20 devstack cinder-volume[82046]: DEBUG cinder.image.image_utils [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] 02b8aec0-dc1c-4b93-81c4-ab6b88d472d9 was qcow2, converting to raw {{(pid=82046) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 24 13:53:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_e2yz6bzcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-34c90930-4c73-40bf-89fd-204c6f4507ba {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:20 devstack sudo[88789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_e2yz6bzcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-34c90930-4c73-40bf-89fd-204c6f4507ba Apr 24 13:53:20 devstack sudo[88789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:21 devstack sudo[88780]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6309a647-99b0-42f2-849b-1dbf6535efb2 tempest-SnapshotsActionsTest-323206228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.bcc9f7de-5b82-458b-b650-fb13f162ae0d" returned: 0 in 0.598s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:21 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-6309a647-99b0-42f2-849b-1dbf6535efb2 tempest-SnapshotsActionsTest-323206228 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.bcc9f7de-5b82-458b-b650-fb13f162ae0d is being set with open permissions: ugo+rw Apr 24 13:53:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6309a647-99b0-42f2-849b-1dbf6535efb2 tempest-SnapshotsActionsTest-323206228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.bcc9f7de-5b82-458b-b650-fb13f162ae0d {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:21 devstack sudo[88793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.bcc9f7de-5b82-458b-b650-fb13f162ae0d Apr 24 13:53:21 devstack sudo[88793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:21 devstack sudo[88782]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-668a0811-2ce5-42a2-8409-e7dc8df1bc7e tempest-VolumesSnapshotTestJSON-952003017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.544s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:21 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-668a0811-2ce5-42a2-8409-e7dc8df1bc7e tempest-VolumesSnapshotTestJSON-952003017 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:53:21 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-668a0811-2ce5-42a2-8409-e7dc8df1bc7e tempest-VolumesSnapshotTestJSON-952003017 None] Deleted volume successfully. Apr 24 13:53:21 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-668a0811-2ce5-42a2-8409-e7dc8df1bc7e tempest-VolumesSnapshotTestJSON-952003017 None] Lock "cinder-0a63b1a2-ff77-473f-9f84-e3bce1619685-delete_volume" released by "delete_volume" :: held 2.160s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:53:21 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-23ecea51-927a-42b3-ae98-4233a19ff36b tempest-VolumesSnapshotTestJSON-952003017 None] Acquiring lock "cinder-0789457d-414f-4c5b-867a-bd0b8b270312-delete_snapshot" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:53:21 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-23ecea51-927a-42b3-ae98-4233a19ff36b tempest-VolumesSnapshotTestJSON-952003017 None] Lock "cinder-0789457d-414f-4c5b-867a-bd0b8b270312-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:53:21 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-23ecea51-927a-42b3-ae98-4233a19ff36b tempest-VolumesSnapshotTestJSON-952003017 None] Acquiring lock "cinder-quobyte-7aecf75e-6c54-409f-b33a-5936d3370740" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:53:21 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-23ecea51-927a-42b3-ae98-4233a19ff36b tempest-VolumesSnapshotTestJSON-952003017 None] Lock "cinder-quobyte-7aecf75e-6c54-409f-b33a-5936d3370740" acquired by "delete_snapshot" :: waited 0.027s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:53:21 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-23ecea51-927a-42b3-ae98-4233a19ff36b tempest-VolumesSnapshotTestJSON-952003017 None] Acquiring lock "cinder-quobyte-0789457d-414f-4c5b-867a-bd0b8b270312" by "_delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:53:21 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-23ecea51-927a-42b3-ae98-4233a19ff36b tempest-VolumesSnapshotTestJSON-952003017 None] Lock "cinder-quobyte-0789457d-414f-4c5b-867a-bd0b8b270312" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:53:21 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-23ecea51-927a-42b3-ae98-4233a19ff36b tempest-VolumesSnapshotTestJSON-952003017 None] Deleting offline snapshot 0789457d-414f-4c5b-867a-bd0b8b270312 of volume 7aecf75e-6c54-409f-b33a-5936d3370740 {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 13:53:21 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-23ecea51-927a-42b3-ae98-4233a19ff36b tempest-VolumesSnapshotTestJSON-952003017 None] snapshot_file for this snap is: volume-7aecf75e-6c54-409f-b33a-5936d3370740.0789457d-414f-4c5b-867a-bd0b8b270312 {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 13:53:21 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3276b8-7564-4d39-a175-20f92bd50ade]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:53:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-23ecea51-927a-42b3-ae98-4233a19ff36b tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740.0789457d-414f-4c5b-867a-bd0b8b270312 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:21 devstack sudo[88798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740.0789457d-414f-4c5b-867a-bd0b8b270312 Apr 24 13:53:21 devstack sudo[88798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:21 devstack sudo[88793]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6309a647-99b0-42f2-849b-1dbf6535efb2 tempest-SnapshotsActionsTest-323206228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.bcc9f7de-5b82-458b-b650-fb13f162ae0d" returned: 0 in 0.698s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-6309a647-99b0-42f2-849b-1dbf6535efb2 tempest-SnapshotsActionsTest-323206228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.877s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:53:21 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-6309a647-99b0-42f2-849b-1dbf6535efb2 tempest-SnapshotsActionsTest-323206228 None] Create snapshot completed successfully Apr 24 13:53:22 devstack sudo[88798]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-23ecea51-927a-42b3-ae98-4233a19ff36b tempest-VolumesSnapshotTestJSON-952003017 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740.0789457d-414f-4c5b-867a-bd0b8b270312" returned: 0 in 0.700s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:22 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-23ecea51-927a-42b3-ae98-4233a19ff36b tempest-VolumesSnapshotTestJSON-952003017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7aecf75e-6c54-409f-b33a-5936d3370740(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:53:22 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecf1c60-cf40-415f-bb96-a5e6f486d4de]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:53:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-23ecea51-927a-42b3-ae98-4233a19ff36b tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:22 devstack sudo[88812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740 Apr 24 13:53:22 devstack sudo[88812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:22 devstack sudo[88789]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_e2yz6bzcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-34c90930-4c73-40bf-89fd-204c6f4507ba" returned: 0 in 1.694s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:22 devstack cinder-volume[82046]: DEBUG cinder.image.image_utils [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_e2yz6bzcdevstack@QuobyteHD, size 112.00 MB, duration 1.70 sec, destination /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-34c90930-4c73-40bf-89fd-204c6f4507ba {{(pid=82046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 13:53:22 devstack cinder-volume[82046]: INFO cinder.image.image_utils [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] Converted 112.00 MB image at 66.04 MB/s Apr 24 13:53:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-34c90930-4c73-40bf-89fd-204c6f4507ba 1G {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:22 devstack sudo[88815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-34c90930-4c73-40bf-89fd-204c6f4507ba 1G Apr 24 13:53:22 devstack sudo[88815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:22 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-8db58081-b266-47e7-8f27-2aea4fe313e0 tempest-SnapshotsActionsTest-786780460 None] Acquiring lock "cinder-bcc9f7de-5b82-458b-b650-fb13f162ae0d-delete_snapshot" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:53:22 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-8db58081-b266-47e7-8f27-2aea4fe313e0 tempest-SnapshotsActionsTest-786780460 None] Lock "cinder-bcc9f7de-5b82-458b-b650-fb13f162ae0d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:53:22 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-8db58081-b266-47e7-8f27-2aea4fe313e0 tempest-SnapshotsActionsTest-786780460 None] Acquiring lock "cinder-quobyte-44a6110a-61e2-4992-af85-a51911520efd" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:53:22 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-8db58081-b266-47e7-8f27-2aea4fe313e0 tempest-SnapshotsActionsTest-786780460 None] Lock "cinder-quobyte-44a6110a-61e2-4992-af85-a51911520efd" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:53:22 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-8db58081-b266-47e7-8f27-2aea4fe313e0 tempest-SnapshotsActionsTest-786780460 None] Acquiring lock "cinder-quobyte-bcc9f7de-5b82-458b-b650-fb13f162ae0d" by "_delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:53:22 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-8db58081-b266-47e7-8f27-2aea4fe313e0 tempest-SnapshotsActionsTest-786780460 None] Lock "cinder-quobyte-bcc9f7de-5b82-458b-b650-fb13f162ae0d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:53:22 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-8db58081-b266-47e7-8f27-2aea4fe313e0 tempest-SnapshotsActionsTest-786780460 None] Deleting offline snapshot bcc9f7de-5b82-458b-b650-fb13f162ae0d of volume 44a6110a-61e2-4992-af85-a51911520efd {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 13:53:22 devstack sudo[88812]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:22 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-8db58081-b266-47e7-8f27-2aea4fe313e0 tempest-SnapshotsActionsTest-786780460 None] snapshot_file for this snap is: volume-44a6110a-61e2-4992-af85-a51911520efd.bcc9f7de-5b82-458b-b650-fb13f162ae0d {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 13:53:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-23ecea51-927a-42b3-ae98-4233a19ff36b tempest-VolumesSnapshotTestJSON-952003017 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740" returned: 0 in 0.696s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-23ecea51-927a-42b3-ae98-4233a19ff36b tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740.0789457d-414f-4c5b-867a-bd0b8b270312 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:22 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[9315fa09-f8c6-4f9e-9127-b6833cdb6bbb]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:53:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8db58081-b266-47e7-8f27-2aea4fe313e0 tempest-SnapshotsActionsTest-786780460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.bcc9f7de-5b82-458b-b650-fb13f162ae0d {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:22 devstack sudo[88819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740.0789457d-414f-4c5b-867a-bd0b8b270312 Apr 24 13:53:22 devstack sudo[88819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:22 devstack sudo[88820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.bcc9f7de-5b82-458b-b650-fb13f162ae0d Apr 24 13:53:22 devstack sudo[88820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:23 devstack sudo[88815]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:23 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-34c90930-4c73-40bf-89fd-204c6f4507ba 1G" returned: 0 in 0.622s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:23 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe8363c-1429-49d7-9b46-e8f9e24abe18]: (4, 'raw') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:53:23 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-34c90930-4c73-40bf-89fd-204c6f4507ba {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:23 devstack sudo[88829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-34c90930-4c73-40bf-89fd-204c6f4507ba Apr 24 13:53:23 devstack sudo[88829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:23 devstack sudo[88819]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:23 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-23ecea51-927a-42b3-ae98-4233a19ff36b tempest-VolumesSnapshotTestJSON-952003017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740.0789457d-414f-4c5b-867a-bd0b8b270312" returned: 0 in 0.629s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:23 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-23ecea51-927a-42b3-ae98-4233a19ff36b tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740.0789457d-414f-4c5b-867a-bd0b8b270312 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:23 devstack sudo[88820]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:23 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8db58081-b266-47e7-8f27-2aea4fe313e0 tempest-SnapshotsActionsTest-786780460 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.bcc9f7de-5b82-458b-b650-fb13f162ae0d" returned: 0 in 0.637s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:23 devstack sudo[88834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740.0789457d-414f-4c5b-867a-bd0b8b270312 Apr 24 13:53:23 devstack sudo[88834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:23 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-8db58081-b266-47e7-8f27-2aea4fe313e0 tempest-SnapshotsActionsTest-786780460 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44a6110a-61e2-4992-af85-a51911520efd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:53:23 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[e507c8f3-ddc1-43dc-90f1-cfbd71da95f2]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:53:23 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8db58081-b266-47e7-8f27-2aea4fe313e0 tempest-SnapshotsActionsTest-786780460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:23 devstack sudo[88836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e Apr 24 13:53:23 devstack sudo[88836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:23 devstack sudo[88829]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:23 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-34c90930-4c73-40bf-89fd-204c6f4507ba" returned: 0 in 0.611s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:23 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-34c90930-4c73-40bf-89fd-204c6f4507ba {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:23 devstack sudo[88834]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:23 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-23ecea51-927a-42b3-ae98-4233a19ff36b tempest-VolumesSnapshotTestJSON-952003017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740.0789457d-414f-4c5b-867a-bd0b8b270312" returned: 0 in 0.492s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:23 devstack sudo[88841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-34c90930-4c73-40bf-89fd-204c6f4507ba Apr 24 13:53:23 devstack sudo[88841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:23 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-23ecea51-927a-42b3-ae98-4233a19ff36b tempest-VolumesSnapshotTestJSON-952003017 None] Lock "cinder-quobyte-0789457d-414f-4c5b-867a-bd0b8b270312" released by "_delete_snapshot" :: held 2.627s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:53:23 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-23ecea51-927a-42b3-ae98-4233a19ff36b tempest-VolumesSnapshotTestJSON-952003017 None] Lock "cinder-quobyte-7aecf75e-6c54-409f-b33a-5936d3370740" released by "delete_snapshot" :: held 2.658s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:53:24 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-23ecea51-927a-42b3-ae98-4233a19ff36b tempest-VolumesSnapshotTestJSON-952003017 None] Created reservations ['39c99927-6be5-4536-9850-5517e63f0da4', '7a0bc769-9e83-4df2-8bc8-863b09f6354f', '33ba0fd4-b91f-47a0-afb1-b9b472d2c5ef', '3a3435ce-25de-482c-87a1-7fa6339767e1'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:53:24 devstack sudo[88836]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8db58081-b266-47e7-8f27-2aea4fe313e0 tempest-SnapshotsActionsTest-786780460 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e" returned: 0 in 0.608s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:24 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-8db58081-b266-47e7-8f27-2aea4fe313e0 tempest-SnapshotsActionsTest-786780460 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44a6110a-61e2-4992-af85-a51911520efd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:53:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8db58081-b266-47e7-8f27-2aea4fe313e0 tempest-SnapshotsActionsTest-786780460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.bcc9f7de-5b82-458b-b650-fb13f162ae0d {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:24 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-23ecea51-927a-42b3-ae98-4233a19ff36b tempest-VolumesSnapshotTestJSON-952003017 None] Delete snapshot completed successfully. Apr 24 13:53:24 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-23ecea51-927a-42b3-ae98-4233a19ff36b tempest-VolumesSnapshotTestJSON-952003017 None] Lock "cinder-0789457d-414f-4c5b-867a-bd0b8b270312-delete_snapshot" released by "delete_snapshot" :: held 2.831s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:53:24 devstack sudo[88846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.bcc9f7de-5b82-458b-b650-fb13f162ae0d Apr 24 13:53:24 devstack sudo[88846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:24 devstack sudo[88841]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-34c90930-4c73-40bf-89fd-204c6f4507ba" returned: 1 in 0.628s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-34c90930-4c73-40bf-89fd-204c6f4507ba' failed. Not Retrying. {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 13:53:24 devstack cinder-volume[82046]: DEBUG cinder.volume.volume_utils [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] Downloaded image 02b8aec0-dc1c-4b93-81c4-ab6b88d472d9 ((None, [{'url': 'file:///opt/stack/data/glance/images/02b8aec0-dc1c-4b93-81c4-ab6b88d472d9', 'metadata': {}}])) to volume 34c90930-4c73-40bf-89fd-204c6f4507ba successfully. {{(pid=82046) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 24 13:53:24 devstack cinder-volume[82046]: DEBUG cinder.image.image_utils [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] Temporary image 02b8aec0-dc1c-4b93-81c4-ab6b88d472d9 for user 742e78f68a264ddc99cf0d1ac442ae21 is deleted. {{(pid=82046) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 24 13:53:24 devstack cinder-volume[82046]: DEBUG cinder.volume.volume_utils [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] Marking volume 34c90930-4c73-40bf-89fd-204c6f4507ba as bootable. {{(pid=82046) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 24 13:53:24 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] Copying metadata from image 02b8aec0-dc1c-4b93-81c4-ab6b88d472d9 to 34c90930-4c73-40bf-89fd-204c6f4507ba. {{(pid=82046) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 24 13:53:24 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] Creating volume glance metadata for volume 34c90930-4c73-40bf-89fd-204c6f4507ba backed by image 02b8aec0-dc1c-4b93-81c4-ab6b88d472d9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '02b8aec0-dc1c-4b93-81c4-ab6b88d472d9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82046) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 24 13:53:24 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b7966ece-4237-411e-9c58-b00af9edcfca tempest-VolumesSnapshotTestJSON-952003017 None] Acquiring lock "cinder-7aecf75e-6c54-409f-b33a-5936d3370740-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:53:24 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b7966ece-4237-411e-9c58-b00af9edcfca tempest-VolumesSnapshotTestJSON-952003017 None] Lock "cinder-7aecf75e-6c54-409f-b33a-5936d3370740-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:53:24 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b7966ece-4237-411e-9c58-b00af9edcfca tempest-VolumesSnapshotTestJSON-952003017 None] Acquiring lock "cinder-quobyte-7aecf75e-6c54-409f-b33a-5936d3370740" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:53:24 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b7966ece-4237-411e-9c58-b00af9edcfca tempest-VolumesSnapshotTestJSON-952003017 None] Lock "cinder-quobyte-7aecf75e-6c54-409f-b33a-5936d3370740" acquired by "delete_volume" :: waited 0.033s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:53:24 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c5332e-acd2-41b8-8488-ed1f99717c45]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:53:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b7966ece-4237-411e-9c58-b00af9edcfca tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:24 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (973a6933-e01d-4136-b8c1-693fa0c7aa77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34c90930-4c73-40bf-89fd-204c6f4507ba', 'volume_size': 1, 'image_id': '02b8aec0-dc1c-4b93-81c4-ab6b88d472d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02b8aec0-dc1c-4b93-81c4-ab6b88d472d9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db6d5b1c41254596bd8bad1e5f7bec28', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02b8aec0-dc1c-4b93-81c4-ab6b88d472d9', 'created_at': datetime.datetime(2026, 4, 24, 11, 39, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 11, 39, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02b8aec0-dc1c-4b93-81c4-ab6b88d472d9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:53:24 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c18f12c3-94ec-439b-a440-c8a5342c1b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:53:24 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] Volume volume-34c90930-4c73-40bf-89fd-204c6f4507ba (34c90930-4c73-40bf-89fd-204c6f4507ba): created successfully Apr 24 13:53:24 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c18f12c3-94ec-439b-a440-c8a5342c1b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:53:24 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] Flow 'volume_create_manager' (1fc2f02d-913f-44ae-8639-ee7de2c57437) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:53:24 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-cf5f4895-de30-4063-9852-037b5922e58c tempest-VolumesExtendTest-1283463981 None] Created volume successfully. Apr 24 13:53:24 devstack sudo[88854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740 Apr 24 13:53:24 devstack sudo[88854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:24 devstack sudo[88846]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8db58081-b266-47e7-8f27-2aea4fe313e0 tempest-SnapshotsActionsTest-786780460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.bcc9f7de-5b82-458b-b650-fb13f162ae0d" returned: 0 in 0.806s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8db58081-b266-47e7-8f27-2aea4fe313e0 tempest-SnapshotsActionsTest-786780460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.bcc9f7de-5b82-458b-b650-fb13f162ae0d {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:24 devstack sudo[88856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.bcc9f7de-5b82-458b-b650-fb13f162ae0d Apr 24 13:53:24 devstack sudo[88856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:25 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f058e4c0-387d-457e-8471-3f32d35a1fe5 tempest-VolumesExtendTest-1283463981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:53:25 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f058e4c0-387d-457e-8471-3f32d35a1fe5 tempest-VolumesExtendTest-1283463981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:53:25 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a138eaa-9d3c-4b4e-989d-b6f03659bd12]: (4, 'raw') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:53:25 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f058e4c0-387d-457e-8471-3f32d35a1fe5 tempest-VolumesExtendTest-1283463981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-34c90930-4c73-40bf-89fd-204c6f4507ba {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:25 devstack sudo[88858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-34c90930-4c73-40bf-89fd-204c6f4507ba Apr 24 13:53:25 devstack sudo[88858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:25 devstack sudo[88854]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:25 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b7966ece-4237-411e-9c58-b00af9edcfca tempest-VolumesSnapshotTestJSON-952003017 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740" returned: 0 in 0.622s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:25 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b7966ece-4237-411e-9c58-b00af9edcfca tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:25 devstack sudo[88864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740 Apr 24 13:53:25 devstack sudo[88864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:25 devstack sudo[88856]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:25 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8db58081-b266-47e7-8f27-2aea4fe313e0 tempest-SnapshotsActionsTest-786780460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.bcc9f7de-5b82-458b-b650-fb13f162ae0d" returned: 0 in 0.522s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:25 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-8db58081-b266-47e7-8f27-2aea4fe313e0 tempest-SnapshotsActionsTest-786780460 None] Lock "cinder-quobyte-bcc9f7de-5b82-458b-b650-fb13f162ae0d" released by "_delete_snapshot" :: held 2.685s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:53:25 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-8db58081-b266-47e7-8f27-2aea4fe313e0 tempest-SnapshotsActionsTest-786780460 None] Lock "cinder-quobyte-44a6110a-61e2-4992-af85-a51911520efd" released by "delete_snapshot" :: held 2.712s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:53:25 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-8db58081-b266-47e7-8f27-2aea4fe313e0 tempest-SnapshotsActionsTest-786780460 None] Created reservations ['d5156dd5-e182-4381-be92-270fef2913fb', '5a04d67e-3eea-4a97-9883-4f7affa9cd65', '59ba5fb2-d2d7-4968-a005-90240fc060ed', '55486753-c3ed-4466-b4e7-52f04a6a708d'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:53:25 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-8db58081-b266-47e7-8f27-2aea4fe313e0 tempest-SnapshotsActionsTest-786780460 None] Delete snapshot completed successfully. Apr 24 13:53:25 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-8db58081-b266-47e7-8f27-2aea4fe313e0 tempest-SnapshotsActionsTest-786780460 None] Lock "cinder-bcc9f7de-5b82-458b-b650-fb13f162ae0d-delete_snapshot" released by "delete_snapshot" :: held 2.894s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:53:25 devstack sudo[88858]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:25 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f058e4c0-387d-457e-8471-3f32d35a1fe5 tempest-VolumesExtendTest-1283463981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-34c90930-4c73-40bf-89fd-204c6f4507ba" returned: 0 in 0.616s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:25 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f058e4c0-387d-457e-8471-3f32d35a1fe5 tempest-VolumesExtendTest-1283463981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-34c90930-4c73-40bf-89fd-204c6f4507ba {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:25 devstack sudo[88869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-34c90930-4c73-40bf-89fd-204c6f4507ba Apr 24 13:53:25 devstack sudo[88869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:25 devstack sudo[88864]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:25 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b7966ece-4237-411e-9c58-b00af9edcfca tempest-VolumesSnapshotTestJSON-952003017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7aecf75e-6c54-409f-b33a-5936d3370740" returned: 0 in 0.509s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:25 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b7966ece-4237-411e-9c58-b00af9edcfca tempest-VolumesSnapshotTestJSON-952003017 None] Lock "cinder-quobyte-7aecf75e-6c54-409f-b33a-5936d3370740" released by "delete_volume" :: held 1.206s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:53:25 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-b7966ece-4237-411e-9c58-b00af9edcfca tempest-VolumesSnapshotTestJSON-952003017 None] Created reservations ['7230c8bb-10c4-446a-b1f5-799d4100606b', '32bfae42-2e87-443a-873b-4fec254334da', 'fb0c77c1-60fd-4edf-8de2-3669d4add241', '6d872c98-f6bf-4a21-8fdb-c9b53591a704'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:53:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b7966ece-4237-411e-9c58-b00af9edcfca tempest-VolumesSnapshotTestJSON-952003017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:53:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b7966ece-4237-411e-9c58-b00af9edcfca tempest-VolumesSnapshotTestJSON-952003017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:53:26 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b7966ece-4237-411e-9c58-b00af9edcfca tempest-VolumesSnapshotTestJSON-952003017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:53:26 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b7966ece-4237-411e-9c58-b00af9edcfca tempest-VolumesSnapshotTestJSON-952003017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:53:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b7966ece-4237-411e-9c58-b00af9edcfca tempest-VolumesSnapshotTestJSON-952003017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:53:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b7966ece-4237-411e-9c58-b00af9edcfca tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:26 devstack sudo[88872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:53:26 devstack sudo[88872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:26 devstack sudo[88869]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f058e4c0-387d-457e-8471-3f32d35a1fe5 tempest-VolumesExtendTest-1283463981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-34c90930-4c73-40bf-89fd-204c6f4507ba" returned: 1 in 0.577s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f058e4c0-387d-457e-8471-3f32d35a1fe5 tempest-VolumesExtendTest-1283463981 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-34c90930-4c73-40bf-89fd-204c6f4507ba' failed. Not Retrying. {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 13:53:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f058e4c0-387d-457e-8471-3f32d35a1fe5 tempest-VolumesExtendTest-1283463981 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-34c90930-4c73-40bf-89fd-204c6f4507ba 2G {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:26 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e33e8010-32a2-400b-b82f-0aa1f9b3f6e0 tempest-SnapshotsActionsTest-323206228 None] Acquiring lock "cinder-7907e6f2-be97-4c34-85be-eaa5fc99686e-delete_snapshot" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:53:26 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e33e8010-32a2-400b-b82f-0aa1f9b3f6e0 tempest-SnapshotsActionsTest-323206228 None] Lock "cinder-7907e6f2-be97-4c34-85be-eaa5fc99686e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:53:26 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e33e8010-32a2-400b-b82f-0aa1f9b3f6e0 tempest-SnapshotsActionsTest-323206228 None] Acquiring lock "cinder-quobyte-44a6110a-61e2-4992-af85-a51911520efd" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:53:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f058e4c0-387d-457e-8471-3f32d35a1fe5 tempest-VolumesExtendTest-1283463981 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-34c90930-4c73-40bf-89fd-204c6f4507ba 2G" returned: 0 in 0.094s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f058e4c0-387d-457e-8471-3f32d35a1fe5 tempest-VolumesExtendTest-1283463981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.331s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:53:26 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e33e8010-32a2-400b-b82f-0aa1f9b3f6e0 tempest-SnapshotsActionsTest-323206228 None] Lock "cinder-quobyte-44a6110a-61e2-4992-af85-a51911520efd" acquired by "delete_snapshot" :: waited 0.048s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:53:26 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e33e8010-32a2-400b-b82f-0aa1f9b3f6e0 tempest-SnapshotsActionsTest-323206228 None] Acquiring lock "cinder-quobyte-7907e6f2-be97-4c34-85be-eaa5fc99686e" by "_delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:53:26 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-f058e4c0-387d-457e-8471-3f32d35a1fe5 tempest-VolumesExtendTest-1283463981 None] Extend volume completed successfully. Apr 24 13:53:26 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e33e8010-32a2-400b-b82f-0aa1f9b3f6e0 tempest-SnapshotsActionsTest-323206228 None] Lock "cinder-quobyte-7907e6f2-be97-4c34-85be-eaa5fc99686e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:53:26 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-e33e8010-32a2-400b-b82f-0aa1f9b3f6e0 tempest-SnapshotsActionsTest-323206228 None] Deleting offline snapshot 7907e6f2-be97-4c34-85be-eaa5fc99686e of volume 44a6110a-61e2-4992-af85-a51911520efd {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 13:53:26 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-e33e8010-32a2-400b-b82f-0aa1f9b3f6e0 tempest-SnapshotsActionsTest-323206228 None] snapshot_file for this snap is: volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 13:53:26 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1948e8-b2a6-4b54-8aa9-754353bca3a7]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:53:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e33e8010-32a2-400b-b82f-0aa1f9b3f6e0 tempest-SnapshotsActionsTest-323206228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:26 devstack sudo[88880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e Apr 24 13:53:26 devstack sudo[88880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:26 devstack sudo[88872]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b7966ece-4237-411e-9c58-b00af9edcfca tempest-VolumesSnapshotTestJSON-952003017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.611s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:26 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-b7966ece-4237-411e-9c58-b00af9edcfca tempest-VolumesSnapshotTestJSON-952003017 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:53:26 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-b7966ece-4237-411e-9c58-b00af9edcfca tempest-VolumesSnapshotTestJSON-952003017 None] Deleted volume successfully. Apr 24 13:53:26 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b7966ece-4237-411e-9c58-b00af9edcfca tempest-VolumesSnapshotTestJSON-952003017 None] Lock "cinder-7aecf75e-6c54-409f-b33a-5936d3370740-delete_volume" released by "delete_volume" :: held 2.120s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:53:27 devstack sudo[88880]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:27 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e33e8010-32a2-400b-b82f-0aa1f9b3f6e0 tempest-SnapshotsActionsTest-323206228 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e" returned: 0 in 0.668s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:27 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-e33e8010-32a2-400b-b82f-0aa1f9b3f6e0 tempest-SnapshotsActionsTest-323206228 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44a6110a-61e2-4992-af85-a51911520efd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:53:27 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[305e05e0-1fd5-469a-9d00-e4454e75b623]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:53:27 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e33e8010-32a2-400b-b82f-0aa1f9b3f6e0 tempest-SnapshotsActionsTest-323206228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:27 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac3d0af3-f74e-4414-a18c-bc8f06803e21 tempest-VolumesSnapshotTestJSON-952003017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:53:27 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-ac3d0af3-f74e-4414-a18c-bc8f06803e21 tempest-VolumesSnapshotTestJSON-952003017 None] Flow 'volume_create_manager' (e4aae9d6-0b36-411f-ad22-bfec2acf91d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:53:27 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-ac3d0af3-f74e-4414-a18c-bc8f06803e21 tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32c78cbb-5a78-432f-a5ca-fa7b569ef810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:53:27 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-ac3d0af3-f74e-4414-a18c-bc8f06803e21 tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32c78cbb-5a78-432f-a5ca-fa7b569ef810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1037840301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1681d7c0-42db-4e10-9f39-221092231230,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81778cce064e41cca9db08dd8c34436d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:53:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:53:27Z,use_quota=True,user_id='828592763a7247db9e1ebd1796caa21e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:53:27 devstack sudo[88886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd Apr 24 13:53:27 devstack sudo[88886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:27 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-ac3d0af3-f74e-4414-a18c-bc8f06803e21 tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (886fffbf-7c75-484c-b788-1a9ebb78c1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:53:27 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-ac3d0af3-f74e-4414-a18c-bc8f06803e21 tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (886fffbf-7c75-484c-b788-1a9ebb78c1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:53:27 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-ac3d0af3-f74e-4414-a18c-bc8f06803e21 tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82a4f177-6dcb-496b-b8b2-d9ec7e6b3af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:53:27 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-ac3d0af3-f74e-4414-a18c-bc8f06803e21 tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82a4f177-6dcb-496b-b8b2-d9ec7e6b3af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1681d7c0-42db-4e10-9f39-221092231230', 'volume_name': 'volume-1681d7c0-42db-4e10-9f39-221092231230', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:53:27 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-ac3d0af3-f74e-4414-a18c-bc8f06803e21 tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bbd7cd6-fa11-4b0a-a95d-87e57a56e07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:53:27 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-ac3d0af3-f74e-4414-a18c-bc8f06803e21 tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bbd7cd6-fa11-4b0a-a95d-87e57a56e07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:53:27 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-ac3d0af3-f74e-4414-a18c-bc8f06803e21 tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bec7c01-13a8-4226-9cc6-b3aa3702e003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:53:27 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-ac3d0af3-f74e-4414-a18c-bc8f06803e21 tempest-VolumesSnapshotTestJSON-952003017 None] Volume 1681d7c0-42db-4e10-9f39-221092231230: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1681d7c0-42db-4e10-9f39-221092231230', 'volume_size': 1} Apr 24 13:53:27 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-ac3d0af3-f74e-4414-a18c-bc8f06803e21 tempest-VolumesSnapshotTestJSON-952003017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:53:27 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-ac3d0af3-f74e-4414-a18c-bc8f06803e21 tempest-VolumesSnapshotTestJSON-952003017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:53:27 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-ac3d0af3-f74e-4414-a18c-bc8f06803e21 tempest-VolumesSnapshotTestJSON-952003017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1037840301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1681d7c0-42db-4e10-9f39-221092231230,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81778cce064e41cca9db08dd8c34436d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:53:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:53:27Z,use_quota=True,user_id='828592763a7247db9e1ebd1796caa21e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:53:27 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-ac3d0af3-f74e-4414-a18c-bc8f06803e21 tempest-VolumesSnapshotTestJSON-952003017 None] Creating volume 1681d7c0-42db-4e10-9f39-221092231230 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:53:27 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-ac3d0af3-f74e-4414-a18c-bc8f06803e21 tempest-VolumesSnapshotTestJSON-952003017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:53:27 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-ac3d0af3-f74e-4414-a18c-bc8f06803e21 tempest-VolumesSnapshotTestJSON-952003017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:53:27 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-ac3d0af3-f74e-4414-a18c-bc8f06803e21 tempest-VolumesSnapshotTestJSON-952003017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:53:27 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-ac3d0af3-f74e-4414-a18c-bc8f06803e21 tempest-VolumesSnapshotTestJSON-952003017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:53:27 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-ac3d0af3-f74e-4414-a18c-bc8f06803e21 tempest-VolumesSnapshotTestJSON-952003017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:53:27 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-ac3d0af3-f74e-4414-a18c-bc8f06803e21 tempest-VolumesSnapshotTestJSON-952003017 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:53:27 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-ac3d0af3-f74e-4414-a18c-bc8f06803e21 tempest-VolumesSnapshotTestJSON-952003017 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:53:27 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ac3d0af3-f74e-4414-a18c-bc8f06803e21 tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:27 devstack sudo[88888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230 1073741824 Apr 24 13:53:27 devstack sudo[88888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:27 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e13e46ca-ff10-464e-9ed8-68b3c4fa3b2e tempest-VolumesExtendTest-1283463981 None] Acquiring lock "cinder-34c90930-4c73-40bf-89fd-204c6f4507ba-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:53:27 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e13e46ca-ff10-464e-9ed8-68b3c4fa3b2e tempest-VolumesExtendTest-1283463981 None] Lock "cinder-34c90930-4c73-40bf-89fd-204c6f4507ba-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:53:27 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e13e46ca-ff10-464e-9ed8-68b3c4fa3b2e tempest-VolumesExtendTest-1283463981 None] Acquiring lock "cinder-quobyte-34c90930-4c73-40bf-89fd-204c6f4507ba" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:53:27 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e13e46ca-ff10-464e-9ed8-68b3c4fa3b2e tempest-VolumesExtendTest-1283463981 None] Lock "cinder-quobyte-34c90930-4c73-40bf-89fd-204c6f4507ba" acquired by "delete_volume" :: waited 0.023s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:53:27 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0f015b-a826-4200-ba20-d4ec60badfa8]: (4, 'raw') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:53:27 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e13e46ca-ff10-464e-9ed8-68b3c4fa3b2e tempest-VolumesExtendTest-1283463981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-34c90930-4c73-40bf-89fd-204c6f4507ba {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:27 devstack sudo[88890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-34c90930-4c73-40bf-89fd-204c6f4507ba Apr 24 13:53:27 devstack sudo[88890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:27 devstack sudo[88886]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:27 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e33e8010-32a2-400b-b82f-0aa1f9b3f6e0 tempest-SnapshotsActionsTest-323206228 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd" returned: 0 in 0.573s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:27 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e33e8010-32a2-400b-b82f-0aa1f9b3f6e0 tempest-SnapshotsActionsTest-323206228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:27 devstack sudo[88895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e Apr 24 13:53:27 devstack sudo[88895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:28 devstack sudo[88888]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ac3d0af3-f74e-4414-a18c-bc8f06803e21 tempest-VolumesSnapshotTestJSON-952003017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230 1073741824" returned: 0 in 0.738s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ac3d0af3-f74e-4414-a18c-bc8f06803e21 tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:28 devstack sudo[88890]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e13e46ca-ff10-464e-9ed8-68b3c4fa3b2e tempest-VolumesExtendTest-1283463981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-34c90930-4c73-40bf-89fd-204c6f4507ba" returned: 0 in 0.556s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e13e46ca-ff10-464e-9ed8-68b3c4fa3b2e tempest-VolumesExtendTest-1283463981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-34c90930-4c73-40bf-89fd-204c6f4507ba {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:28 devstack sudo[88902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230 Apr 24 13:53:28 devstack sudo[88902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:28 devstack sudo[88903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-34c90930-4c73-40bf-89fd-204c6f4507ba Apr 24 13:53:28 devstack sudo[88903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:28 devstack sudo[88895]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e33e8010-32a2-400b-b82f-0aa1f9b3f6e0 tempest-SnapshotsActionsTest-323206228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e" returned: 0 in 0.659s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e33e8010-32a2-400b-b82f-0aa1f9b3f6e0 tempest-SnapshotsActionsTest-323206228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:28 devstack sudo[88909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e Apr 24 13:53:28 devstack sudo[88909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:28 devstack sudo[88902]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ac3d0af3-f74e-4414-a18c-bc8f06803e21 tempest-VolumesSnapshotTestJSON-952003017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230" returned: 0 in 0.451s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:28 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-ac3d0af3-f74e-4414-a18c-bc8f06803e21 tempest-VolumesSnapshotTestJSON-952003017 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:53:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-ac3d0af3-f74e-4414-a18c-bc8f06803e21 tempest-VolumesSnapshotTestJSON-952003017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.240s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:53:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-ac3d0af3-f74e-4414-a18c-bc8f06803e21 tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bec7c01-13a8-4226-9cc6-b3aa3702e003) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1681d7c0-42db-4e10-9f39-221092231230', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:53:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-ac3d0af3-f74e-4414-a18c-bc8f06803e21 tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12ee73af-3fa8-4ec0-9cc5-cb6addba545f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:53:28 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-ac3d0af3-f74e-4414-a18c-bc8f06803e21 tempest-VolumesSnapshotTestJSON-952003017 None] Volume volume-1681d7c0-42db-4e10-9f39-221092231230 (1681d7c0-42db-4e10-9f39-221092231230): created successfully Apr 24 13:53:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-ac3d0af3-f74e-4414-a18c-bc8f06803e21 tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12ee73af-3fa8-4ec0-9cc5-cb6addba545f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:53:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-ac3d0af3-f74e-4414-a18c-bc8f06803e21 tempest-VolumesSnapshotTestJSON-952003017 None] Flow 'volume_create_manager' (e4aae9d6-0b36-411f-ad22-bfec2acf91d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:53:28 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-ac3d0af3-f74e-4414-a18c-bc8f06803e21 tempest-VolumesSnapshotTestJSON-952003017 None] Created volume successfully. Apr 24 13:53:28 devstack sudo[88903]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e13e46ca-ff10-464e-9ed8-68b3c4fa3b2e tempest-VolumesExtendTest-1283463981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-34c90930-4c73-40bf-89fd-204c6f4507ba" returned: 1 in 0.620s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e13e46ca-ff10-464e-9ed8-68b3c4fa3b2e tempest-VolumesExtendTest-1283463981 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-34c90930-4c73-40bf-89fd-204c6f4507ba' failed. Not Retrying. {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 13:53:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e13e46ca-ff10-464e-9ed8-68b3c4fa3b2e tempest-VolumesExtendTest-1283463981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-34c90930-4c73-40bf-89fd-204c6f4507ba {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:28 devstack sudo[88915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-34c90930-4c73-40bf-89fd-204c6f4507ba Apr 24 13:53:28 devstack sudo[88915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:28 devstack sudo[88909]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e33e8010-32a2-400b-b82f-0aa1f9b3f6e0 tempest-SnapshotsActionsTest-323206228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd.7907e6f2-be97-4c34-85be-eaa5fc99686e" returned: 0 in 0.516s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:29 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e33e8010-32a2-400b-b82f-0aa1f9b3f6e0 tempest-SnapshotsActionsTest-323206228 None] Lock "cinder-quobyte-7907e6f2-be97-4c34-85be-eaa5fc99686e" released by "_delete_snapshot" :: held 2.557s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:53:29 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e33e8010-32a2-400b-b82f-0aa1f9b3f6e0 tempest-SnapshotsActionsTest-323206228 None] Lock "cinder-quobyte-44a6110a-61e2-4992-af85-a51911520efd" released by "delete_snapshot" :: held 2.583s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:53:29 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-e33e8010-32a2-400b-b82f-0aa1f9b3f6e0 tempest-SnapshotsActionsTest-323206228 None] Created reservations ['97c0ef75-34e3-4511-a1c4-ee736ffaef0a', 'f10f8392-76e6-4c5d-ab07-54f1cd1afcdc', '2dd67a92-e2b0-4377-8fa6-364a9fe98628', '6fb00c98-0e63-4b45-aec7-e65f3102c114'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:53:29 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-e33e8010-32a2-400b-b82f-0aa1f9b3f6e0 tempest-SnapshotsActionsTest-323206228 None] Delete snapshot completed successfully. Apr 24 13:53:29 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e33e8010-32a2-400b-b82f-0aa1f9b3f6e0 tempest-SnapshotsActionsTest-323206228 None] Lock "cinder-7907e6f2-be97-4c34-85be-eaa5fc99686e-delete_snapshot" released by "delete_snapshot" :: held 2.765s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:53:29 devstack sudo[88915]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e13e46ca-ff10-464e-9ed8-68b3c4fa3b2e tempest-VolumesExtendTest-1283463981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-34c90930-4c73-40bf-89fd-204c6f4507ba" returned: 0 in 0.484s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:29 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e13e46ca-ff10-464e-9ed8-68b3c4fa3b2e tempest-VolumesExtendTest-1283463981 None] Lock "cinder-quobyte-34c90930-4c73-40bf-89fd-204c6f4507ba" released by "delete_volume" :: held 1.726s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:53:29 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-e13e46ca-ff10-464e-9ed8-68b3c4fa3b2e tempest-VolumesExtendTest-1283463981 None] Created reservations ['315d315a-7038-4502-b720-2148c8ffcb6d', 'e0f7d0e4-58f8-4671-a71f-76ab2e8a3fb6', '4e45c785-19a4-44ea-9e82-3bed14894d8e', 'ca909cff-bd32-4677-9843-f240f2b00672'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:53:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-e13e46ca-ff10-464e-9ed8-68b3c4fa3b2e tempest-VolumesExtendTest-1283463981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:53:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-e13e46ca-ff10-464e-9ed8-68b3c4fa3b2e tempest-VolumesExtendTest-1283463981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:53:29 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-e13e46ca-ff10-464e-9ed8-68b3c4fa3b2e tempest-VolumesExtendTest-1283463981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:53:29 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-e13e46ca-ff10-464e-9ed8-68b3c4fa3b2e tempest-VolumesExtendTest-1283463981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:53:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-e13e46ca-ff10-464e-9ed8-68b3c4fa3b2e tempest-VolumesExtendTest-1283463981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:53:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e13e46ca-ff10-464e-9ed8-68b3c4fa3b2e tempest-VolumesExtendTest-1283463981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:29 devstack sudo[88919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:53:29 devstack sudo[88919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4051ecc8-3625-4888-918f-e52eeb1ba89b tempest-VolumesSnapshotTestJSON-952003017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:53:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4051ecc8-3625-4888-918f-e52eeb1ba89b tempest-VolumesSnapshotTestJSON-952003017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:53:29 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-4051ecc8-3625-4888-918f-e52eeb1ba89b tempest-VolumesSnapshotTestJSON-952003017 None] Creating offline snapshot f2c01b36-c2e9-4c0c-bf2d-79d467da3269 of volume 1681d7c0-42db-4e10-9f39-221092231230 {{(pid=82046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 13:53:29 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[06eaf987-dde4-4edf-a5e4-0228d96d4414]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:53:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4051ecc8-3625-4888-918f-e52eeb1ba89b tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:29 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b8ffd3a8-d52c-4f1c-987b-883676bcd51a tempest-SnapshotsActionsTest-323206228 None] Acquiring lock "cinder-44a6110a-61e2-4992-af85-a51911520efd-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:53:29 devstack sudo[88921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230 Apr 24 13:53:29 devstack sudo[88921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:29 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b8ffd3a8-d52c-4f1c-987b-883676bcd51a tempest-SnapshotsActionsTest-323206228 None] Lock "cinder-44a6110a-61e2-4992-af85-a51911520efd-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:53:29 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b8ffd3a8-d52c-4f1c-987b-883676bcd51a tempest-SnapshotsActionsTest-323206228 None] Acquiring lock "cinder-quobyte-44a6110a-61e2-4992-af85-a51911520efd" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:53:29 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b8ffd3a8-d52c-4f1c-987b-883676bcd51a tempest-SnapshotsActionsTest-323206228 None] Lock "cinder-quobyte-44a6110a-61e2-4992-af85-a51911520efd" acquired by "delete_volume" :: waited 0.019s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:53:29 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[137dbf6f-af4e-4adb-809d-06a1f0483887]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:53:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b8ffd3a8-d52c-4f1c-987b-883676bcd51a tempest-SnapshotsActionsTest-323206228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:29 devstack sudo[88923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd Apr 24 13:53:29 devstack sudo[88923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:30 devstack sudo[88919]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e13e46ca-ff10-464e-9ed8-68b3c4fa3b2e tempest-VolumesExtendTest-1283463981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.677s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:30 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-e13e46ca-ff10-464e-9ed8-68b3c4fa3b2e tempest-VolumesExtendTest-1283463981 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:53:30 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-e13e46ca-ff10-464e-9ed8-68b3c4fa3b2e tempest-VolumesExtendTest-1283463981 None] Deleted volume successfully. Apr 24 13:53:30 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d6ea009-212c-4b99-acfa-e472780b9bd1 tempest-VolumesExtendTest-1283463981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:53:30 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0d6ea009-212c-4b99-acfa-e472780b9bd1 tempest-VolumesExtendTest-1283463981 None] Flow 'volume_create_manager' (a16fc495-f339-4d95-9551-33d4fef8c00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:53:30 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0d6ea009-212c-4b99-acfa-e472780b9bd1 tempest-VolumesExtendTest-1283463981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06a9a452-ba47-4a79-a953-2dbeee52f30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:53:30 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e13e46ca-ff10-464e-9ed8-68b3c4fa3b2e tempest-VolumesExtendTest-1283463981 None] Lock "cinder-34c90930-4c73-40bf-89fd-204c6f4507ba-delete_volume" released by "delete_volume" :: held 2.675s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:53:30 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0d6ea009-212c-4b99-acfa-e472780b9bd1 tempest-VolumesExtendTest-1283463981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06a9a452-ba47-4a79-a953-2dbeee52f30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:53:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1311956814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c728b873-eb17-44a1-8003-76dfa473f2a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0344dc0e505545448d8a4f3eb4fd7ed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:53:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:53:30Z,use_quota=True,user_id='742e78f68a264ddc99cf0d1ac442ae21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:53:30 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0d6ea009-212c-4b99-acfa-e472780b9bd1 tempest-VolumesExtendTest-1283463981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fbe82c4-3e19-448f-9af8-ef158d6c35f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:53:30 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0d6ea009-212c-4b99-acfa-e472780b9bd1 tempest-VolumesExtendTest-1283463981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fbe82c4-3e19-448f-9af8-ef158d6c35f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:53:30 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0d6ea009-212c-4b99-acfa-e472780b9bd1 tempest-VolumesExtendTest-1283463981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (630eb9a7-7e44-43ce-a750-25393ffe40b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:53:30 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0d6ea009-212c-4b99-acfa-e472780b9bd1 tempest-VolumesExtendTest-1283463981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (630eb9a7-7e44-43ce-a750-25393ffe40b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c728b873-eb17-44a1-8003-76dfa473f2a4', 'volume_name': 'volume-c728b873-eb17-44a1-8003-76dfa473f2a4', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:53:30 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0d6ea009-212c-4b99-acfa-e472780b9bd1 tempest-VolumesExtendTest-1283463981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a32de24b-c03b-4bca-bdd7-2a43e3fec17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:53:30 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0d6ea009-212c-4b99-acfa-e472780b9bd1 tempest-VolumesExtendTest-1283463981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a32de24b-c03b-4bca-bdd7-2a43e3fec17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:53:30 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0d6ea009-212c-4b99-acfa-e472780b9bd1 tempest-VolumesExtendTest-1283463981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (555b8e94-43f6-4cd2-9477-6620c3e22290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:53:30 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-0d6ea009-212c-4b99-acfa-e472780b9bd1 tempest-VolumesExtendTest-1283463981 None] Volume c728b873-eb17-44a1-8003-76dfa473f2a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c728b873-eb17-44a1-8003-76dfa473f2a4', 'volume_size': 1} Apr 24 13:53:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0d6ea009-212c-4b99-acfa-e472780b9bd1 tempest-VolumesExtendTest-1283463981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:53:30 devstack sudo[88921]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4051ecc8-3625-4888-918f-e52eeb1ba89b tempest-VolumesSnapshotTestJSON-952003017 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230" returned: 0 in 0.736s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4051ecc8-3625-4888-918f-e52eeb1ba89b tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230.f2c01b36-c2e9-4c0c-bf2d-79d467da3269 1G {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:30 devstack sudo[88929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230.f2c01b36-c2e9-4c0c-bf2d-79d467da3269 1G Apr 24 13:53:30 devstack sudo[88929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:30 devstack sudo[88923]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b8ffd3a8-d52c-4f1c-987b-883676bcd51a tempest-SnapshotsActionsTest-323206228 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd" returned: 0 in 0.703s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b8ffd3a8-d52c-4f1c-987b-883676bcd51a tempest-SnapshotsActionsTest-323206228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:30 devstack sudo[88934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd Apr 24 13:53:30 devstack sudo[88934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:30 devstack sudo[88929]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4051ecc8-3625-4888-918f-e52eeb1ba89b tempest-VolumesSnapshotTestJSON-952003017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230.f2c01b36-c2e9-4c0c-bf2d-79d467da3269 1G" returned: 0 in 0.660s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4051ecc8-3625-4888-918f-e52eeb1ba89b tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1681d7c0-42db-4e10-9f39-221092231230 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230.f2c01b36-c2e9-4c0c-bf2d-79d467da3269 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:31 devstack sudo[88940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1681d7c0-42db-4e10-9f39-221092231230 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230.f2c01b36-c2e9-4c0c-bf2d-79d467da3269 Apr 24 13:53:31 devstack sudo[88940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:31 devstack sudo[88934]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b8ffd3a8-d52c-4f1c-987b-883676bcd51a tempest-SnapshotsActionsTest-323206228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44a6110a-61e2-4992-af85-a51911520efd" returned: 0 in 0.550s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:31 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b8ffd3a8-d52c-4f1c-987b-883676bcd51a tempest-SnapshotsActionsTest-323206228 None] Lock "cinder-quobyte-44a6110a-61e2-4992-af85-a51911520efd" released by "delete_volume" :: held 1.319s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:53:31 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-b8ffd3a8-d52c-4f1c-987b-883676bcd51a tempest-SnapshotsActionsTest-323206228 None] Created reservations ['a9aac7e2-cbee-473d-8773-756eb257e87f', '9f41b032-331c-4631-8f36-d4b9d6cc9ac7', '0f31f4f4-7e5b-4f0b-973c-a61fa571acc7', 'c7b5047d-a8b5-4076-865e-1c4ffda22a0a'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:53:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b8ffd3a8-d52c-4f1c-987b-883676bcd51a tempest-SnapshotsActionsTest-323206228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:53:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b8ffd3a8-d52c-4f1c-987b-883676bcd51a tempest-SnapshotsActionsTest-323206228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:53:31 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b8ffd3a8-d52c-4f1c-987b-883676bcd51a tempest-SnapshotsActionsTest-323206228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:53:31 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b8ffd3a8-d52c-4f1c-987b-883676bcd51a tempest-SnapshotsActionsTest-323206228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:53:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b8ffd3a8-d52c-4f1c-987b-883676bcd51a tempest-SnapshotsActionsTest-323206228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:53:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b8ffd3a8-d52c-4f1c-987b-883676bcd51a tempest-SnapshotsActionsTest-323206228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:31 devstack sudo[88942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:53:31 devstack sudo[88942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:31 devstack sudo[88940]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4051ecc8-3625-4888-918f-e52eeb1ba89b tempest-VolumesSnapshotTestJSON-952003017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1681d7c0-42db-4e10-9f39-221092231230 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230.f2c01b36-c2e9-4c0c-bf2d-79d467da3269" returned: 0 in 0.501s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:31 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-4051ecc8-3625-4888-918f-e52eeb1ba89b tempest-VolumesSnapshotTestJSON-952003017 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230.f2c01b36-c2e9-4c0c-bf2d-79d467da3269 is being set with open permissions: ugo+rw Apr 24 13:53:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4051ecc8-3625-4888-918f-e52eeb1ba89b tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230.f2c01b36-c2e9-4c0c-bf2d-79d467da3269 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:31 devstack sudo[88947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230.f2c01b36-c2e9-4c0c-bf2d-79d467da3269 Apr 24 13:53:31 devstack sudo[88947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:31 devstack sudo[88942]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b8ffd3a8-d52c-4f1c-987b-883676bcd51a tempest-SnapshotsActionsTest-323206228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.565s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:31 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-b8ffd3a8-d52c-4f1c-987b-883676bcd51a tempest-SnapshotsActionsTest-323206228 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:53:31 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-b8ffd3a8-d52c-4f1c-987b-883676bcd51a tempest-SnapshotsActionsTest-323206228 None] Deleted volume successfully. Apr 24 13:53:31 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b8ffd3a8-d52c-4f1c-987b-883676bcd51a tempest-SnapshotsActionsTest-323206228 None] Lock "cinder-44a6110a-61e2-4992-af85-a51911520efd-delete_volume" released by "delete_volume" :: held 2.100s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:53:31 devstack sudo[88947]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4051ecc8-3625-4888-918f-e52eeb1ba89b tempest-VolumesSnapshotTestJSON-952003017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230.f2c01b36-c2e9-4c0c-bf2d-79d467da3269" returned: 0 in 0.478s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4051ecc8-3625-4888-918f-e52eeb1ba89b tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:32 devstack sudo[88951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230.info Apr 24 13:53:32 devstack sudo[88951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:32 devstack sudo[88951]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4051ecc8-3625-4888-918f-e52eeb1ba89b tempest-VolumesSnapshotTestJSON-952003017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230.info" returned: 0 in 0.556s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:32 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-4051ecc8-3625-4888-918f-e52eeb1ba89b tempest-VolumesSnapshotTestJSON-952003017 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230.info is being set with open permissions: ugo+rw Apr 24 13:53:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4051ecc8-3625-4888-918f-e52eeb1ba89b tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:32 devstack sudo[88955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230.info Apr 24 13:53:32 devstack sudo[88955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:33 devstack sudo[88955]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4051ecc8-3625-4888-918f-e52eeb1ba89b tempest-VolumesSnapshotTestJSON-952003017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230.info" returned: 0 in 0.536s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4051ecc8-3625-4888-918f-e52eeb1ba89b tempest-VolumesSnapshotTestJSON-952003017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.566s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:53:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0d6ea009-212c-4b99-acfa-e472780b9bd1 tempest-VolumesExtendTest-1283463981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.888s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:53:33 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-0d6ea009-212c-4b99-acfa-e472780b9bd1 tempest-VolumesExtendTest-1283463981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:53:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1311956814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c728b873-eb17-44a1-8003-76dfa473f2a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0344dc0e505545448d8a4f3eb4fd7ed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:53:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:53:30Z,use_quota=True,user_id='742e78f68a264ddc99cf0d1ac442ae21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:53:33 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-0d6ea009-212c-4b99-acfa-e472780b9bd1 tempest-VolumesExtendTest-1283463981 None] Creating volume c728b873-eb17-44a1-8003-76dfa473f2a4 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:53:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0d6ea009-212c-4b99-acfa-e472780b9bd1 tempest-VolumesExtendTest-1283463981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:53:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0d6ea009-212c-4b99-acfa-e472780b9bd1 tempest-VolumesExtendTest-1283463981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:53:33 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-0d6ea009-212c-4b99-acfa-e472780b9bd1 tempest-VolumesExtendTest-1283463981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:53:33 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-0d6ea009-212c-4b99-acfa-e472780b9bd1 tempest-VolumesExtendTest-1283463981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:53:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0d6ea009-212c-4b99-acfa-e472780b9bd1 tempest-VolumesExtendTest-1283463981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:53:33 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-0d6ea009-212c-4b99-acfa-e472780b9bd1 tempest-VolumesExtendTest-1283463981 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:53:33 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-0d6ea009-212c-4b99-acfa-e472780b9bd1 tempest-VolumesExtendTest-1283463981 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:53:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0d6ea009-212c-4b99-acfa-e472780b9bd1 tempest-VolumesExtendTest-1283463981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c728b873-eb17-44a1-8003-76dfa473f2a4 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:33 devstack sudo[88960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c728b873-eb17-44a1-8003-76dfa473f2a4 1073741824 Apr 24 13:53:33 devstack sudo[88960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:33 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-4051ecc8-3625-4888-918f-e52eeb1ba89b tempest-VolumesSnapshotTestJSON-952003017 None] Create snapshot completed successfully Apr 24 13:53:33 devstack sudo[88960]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0d6ea009-212c-4b99-acfa-e472780b9bd1 tempest-VolumesExtendTest-1283463981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c728b873-eb17-44a1-8003-76dfa473f2a4 1073741824" returned: 0 in 0.817s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0d6ea009-212c-4b99-acfa-e472780b9bd1 tempest-VolumesExtendTest-1283463981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c728b873-eb17-44a1-8003-76dfa473f2a4 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:34 devstack sudo[88965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c728b873-eb17-44a1-8003-76dfa473f2a4 Apr 24 13:53:34 devstack sudo[88965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:34 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:53:34 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] Flow 'volume_create_manager' (d68b8a62-03f6-462b-8476-dc135f2f7ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:53:34 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74c6538f-e1f4-4221-ad98-143be671c6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:53:34 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74c6538f-e1f4-4221-ad98-143be671c6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2007929692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f55d08c8-5289-4964-b23d-2fb02b1bb7c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81778cce064e41cca9db08dd8c34436d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f2c01b36-c2e9-4c0c-bf2d-79d467da3269,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:53:34Z,use_quota=True,user_id='828592763a7247db9e1ebd1796caa21e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:53:34 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28dd1064-b466-41d7-8352-8c1cbd41772e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:53:34 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28dd1064-b466-41d7-8352-8c1cbd41772e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:53:34 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81247339-d48d-4d0d-87f4-5e335a86a838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:53:34 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81247339-d48d-4d0d-87f4-5e335a86a838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f55d08c8-5289-4964-b23d-2fb02b1bb7c5', 'volume_name': 'volume-f55d08c8-5289-4964-b23d-2fb02b1bb7c5', 'volume_size': 1, 'snapshot_id': 'f2c01b36-c2e9-4c0c-bf2d-79d467da3269'}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:53:34 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b780d9a7-3104-4b68-b5d3-c3c47da5c857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:53:34 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b780d9a7-3104-4b68-b5d3-c3c47da5c857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:53:34 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edf1afaf-4b37-44fc-9e2a-28e0913050e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:53:34 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] Volume f55d08c8-5289-4964-b23d-2fb02b1bb7c5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f55d08c8-5289-4964-b23d-2fb02b1bb7c5', 'volume_size': 1, 'snapshot_id': 'f2c01b36-c2e9-4c0c-bf2d-79d467da3269'} Apr 24 13:53:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:53:34 devstack sudo[88965]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0d6ea009-212c-4b99-acfa-e472780b9bd1 tempest-VolumesExtendTest-1283463981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c728b873-eb17-44a1-8003-76dfa473f2a4" returned: 0 in 0.559s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:34 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-0d6ea009-212c-4b99-acfa-e472780b9bd1 tempest-VolumesExtendTest-1283463981 None] <== create_volume: return (1417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:53:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0d6ea009-212c-4b99-acfa-e472780b9bd1 tempest-VolumesExtendTest-1283463981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.420s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:53:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.080s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:53:34 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] Acquiring lock "cinder-quobyte-f2c01b36-c2e9-4c0c-bf2d-79d467da3269-f55d08c8-5289-4964-b23d-2fb02b1bb7c5" by "_create_volume_from_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:53:34 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0d6ea009-212c-4b99-acfa-e472780b9bd1 tempest-VolumesExtendTest-1283463981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (555b8e94-43f6-4cd2-9477-6620c3e22290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c728b873-eb17-44a1-8003-76dfa473f2a4', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:53:34 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0d6ea009-212c-4b99-acfa-e472780b9bd1 tempest-VolumesExtendTest-1283463981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (007ffa19-4b4c-4fcd-a24b-c53a61e41f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:53:34 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] Lock "cinder-quobyte-f2c01b36-c2e9-4c0c-bf2d-79d467da3269-f55d08c8-5289-4964-b23d-2fb02b1bb7c5" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:53:34 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] Creating volume f55d08c8-5289-4964-b23d-2fb02b1bb7c5 from snapshot f2c01b36-c2e9-4c0c-bf2d-79d467da3269 {{(pid=82046) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 13:53:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:53:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:53:34 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:53:34 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:53:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:53:34 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:53:34 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] Acquiring lock "cinder-quobyte-f55d08c8-5289-4964-b23d-2fb02b1bb7c5" by "_copy_volume_from_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:53:34 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-0d6ea009-212c-4b99-acfa-e472780b9bd1 tempest-VolumesExtendTest-1283463981 None] Volume volume-c728b873-eb17-44a1-8003-76dfa473f2a4 (c728b873-eb17-44a1-8003-76dfa473f2a4): created successfully Apr 24 13:53:34 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0d6ea009-212c-4b99-acfa-e472780b9bd1 tempest-VolumesExtendTest-1283463981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (007ffa19-4b4c-4fcd-a24b-c53a61e41f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:53:34 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0d6ea009-212c-4b99-acfa-e472780b9bd1 tempest-VolumesExtendTest-1283463981 None] Flow 'volume_create_manager' (a16fc495-f339-4d95-9551-33d4fef8c00d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:53:34 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-0d6ea009-212c-4b99-acfa-e472780b9bd1 tempest-VolumesExtendTest-1283463981 None] Created volume successfully. Apr 24 13:53:34 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] Lock "cinder-quobyte-f55d08c8-5289-4964-b23d-2fb02b1bb7c5" acquired by "_copy_volume_from_snapshot" :: waited 0.052s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:53:34 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] snapshot: f2c01b36-c2e9-4c0c-bf2d-79d467da3269, volume: f55d08c8-5289-4964-b23d-2fb02b1bb7c5, {{(pid=82046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 13:53:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:53:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:53:34 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:53:34 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:53:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:53:34 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[42205c2a-f5bc-4d3c-acbc-f90f00bc23f3]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:53:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230.f2c01b36-c2e9-4c0c-bf2d-79d467da3269 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:34 devstack sudo[88968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230.f2c01b36-c2e9-4c0c-bf2d-79d467da3269 Apr 24 13:53:34 devstack sudo[88968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:35 devstack sudo[88968]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230.f2c01b36-c2e9-4c0c-bf2d-79d467da3269" returned: 0 in 0.663s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:35 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1681d7c0-42db-4e10-9f39-221092231230(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:53:35 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230 {{(pid=82046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 13:53:35 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] Creating direct copy from snapshot {{(pid=82046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 13:53:35 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2936a24-11c7-41c4-ad2c-7d6008cab0b9]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:53:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:35 devstack sudo[88973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230 Apr 24 13:53:35 devstack sudo[88973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-ebf6feb9-dd39-4c6b-b4aa-02703538a75f tempest-VolumesExtendTest-1283463981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:53:36 devstack sudo[88973]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230" returned: 0 in 0.701s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:36 devstack cinder-volume[82046]: DEBUG cinder.utils [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] Path /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f55d08c8-5289-4964-b23d-2fb02b1bb7c5 not found in is_blk_device check {{(pid=82046) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 13:53:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f55d08c8-5289-4964-b23d-2fb02b1bb7c5 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:36 devstack sudo[88979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f55d08c8-5289-4964-b23d-2fb02b1bb7c5 Apr 24 13:53:36 devstack sudo[88979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:37 devstack cinder-volume[82046]: DEBUG oslo_service.periodic_task [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82046) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 13:53:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:53:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:53:37 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:53:37 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:53:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:53:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:38 devstack sudo[88991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:53:38 devstack sudo[88991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:38 devstack sudo[88991]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.886s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:38 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:53:42 devstack sudo[88979]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:42 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f55d08c8-5289-4964-b23d-2fb02b1bb7c5" returned: 0 in 6.218s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:42 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0cedb7-c746-47e5-9641-1be39b6e5a68]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:53:42 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:42 devstack sudo[88995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230 Apr 24 13:53:42 devstack sudo[88995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:43 devstack sudo[88995]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230" returned: 0 in 0.872s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:43 devstack cinder-volume[82046]: DEBUG cinder.image.image_utils [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] Image conversion details: src /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230, size 1024.00 MB, duration 6.22 sec, destination /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f55d08c8-5289-4964-b23d-2fb02b1bb7c5 {{(pid=82046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 13:53:43 devstack cinder-volume[82046]: INFO cinder.image.image_utils [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] Converted 1024.00 MB image at 164.67 MB/s Apr 24 13:53:43 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f55d08c8-5289-4964-b23d-2fb02b1bb7c5 is being set with open permissions: ugo+rw Apr 24 13:53:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f55d08c8-5289-4964-b23d-2fb02b1bb7c5 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:43 devstack sudo[89000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f55d08c8-5289-4964-b23d-2fb02b1bb7c5 Apr 24 13:53:43 devstack sudo[89000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:43 devstack sudo[89000]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f55d08c8-5289-4964-b23d-2fb02b1bb7c5" returned: 0 in 0.515s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:43 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] Lock "cinder-quobyte-f55d08c8-5289-4964-b23d-2fb02b1bb7c5" released by "_copy_volume_from_snapshot" :: held 9.104s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:53:43 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] Lock "cinder-quobyte-f2c01b36-c2e9-4c0c-bf2d-79d467da3269-f55d08c8-5289-4964-b23d-2fb02b1bb7c5" released by "_create_volume_from_snapshot" :: held 9.179s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:53:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.220s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:53:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-ebf6feb9-dd39-4c6b-b4aa-02703538a75f tempest-VolumesExtendTest-1283463981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.065s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:53:43 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-ebf6feb9-dd39-4c6b-b4aa-02703538a75f tempest-VolumesExtendTest-1283463981 None] Creating offline snapshot f3c42b5a-76d8-49eb-b032-40bc060dede6 of volume c728b873-eb17-44a1-8003-76dfa473f2a4 {{(pid=82046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 13:53:43 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c279c9-3547-4e7e-82d5-bdc8c0b15471]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:53:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ebf6feb9-dd39-4c6b-b4aa-02703538a75f tempest-VolumesExtendTest-1283463981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c728b873-eb17-44a1-8003-76dfa473f2a4 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:43 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edf1afaf-4b37-44fc-9e2a-28e0913050e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f55d08c8-5289-4964-b23d-2fb02b1bb7c5', 'volume_size': 1, 'snapshot_id': 'f2c01b36-c2e9-4c0c-bf2d-79d467da3269'}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:53:43 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2719b48-a19b-4461-9a00-27180ad84fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:53:43 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] Volume volume-f55d08c8-5289-4964-b23d-2fb02b1bb7c5 (f55d08c8-5289-4964-b23d-2fb02b1bb7c5): created successfully Apr 24 13:53:43 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2719b48-a19b-4461-9a00-27180ad84fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:53:43 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] Flow 'volume_create_manager' (d68b8a62-03f6-462b-8476-dc135f2f7ce8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:53:43 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-b5e1323c-0e06-49c3-8b23-561701679f3f tempest-VolumesSnapshotTestJSON-952003017 None] Created volume successfully. Apr 24 13:53:43 devstack sudo[89003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c728b873-eb17-44a1-8003-76dfa473f2a4 Apr 24 13:53:43 devstack sudo[89003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:44 devstack sudo[89003]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ebf6feb9-dd39-4c6b-b4aa-02703538a75f tempest-VolumesExtendTest-1283463981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c728b873-eb17-44a1-8003-76dfa473f2a4" returned: 0 in 0.613s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ebf6feb9-dd39-4c6b-b4aa-02703538a75f tempest-VolumesExtendTest-1283463981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c728b873-eb17-44a1-8003-76dfa473f2a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c728b873-eb17-44a1-8003-76dfa473f2a4.f3c42b5a-76d8-49eb-b032-40bc060dede6 1G {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:44 devstack sudo[89008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c728b873-eb17-44a1-8003-76dfa473f2a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c728b873-eb17-44a1-8003-76dfa473f2a4.f3c42b5a-76d8-49eb-b032-40bc060dede6 1G Apr 24 13:53:44 devstack sudo[89008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:44 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-4d91643c-878c-417a-aba2-cf2a38a6a068 tempest-VolumesSnapshotTestJSON-952003017 None] Acquiring lock "cinder-f55d08c8-5289-4964-b23d-2fb02b1bb7c5-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:53:44 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-4d91643c-878c-417a-aba2-cf2a38a6a068 tempest-VolumesSnapshotTestJSON-952003017 None] Lock "cinder-f55d08c8-5289-4964-b23d-2fb02b1bb7c5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:53:44 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-4d91643c-878c-417a-aba2-cf2a38a6a068 tempest-VolumesSnapshotTestJSON-952003017 None] Acquiring lock "cinder-quobyte-f55d08c8-5289-4964-b23d-2fb02b1bb7c5" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:53:44 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-4d91643c-878c-417a-aba2-cf2a38a6a068 tempest-VolumesSnapshotTestJSON-952003017 None] Lock "cinder-quobyte-f55d08c8-5289-4964-b23d-2fb02b1bb7c5" acquired by "delete_volume" :: waited 0.020s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:53:44 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aba257b-3450-4b80-967f-87ed9b0a83b0]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:53:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4d91643c-878c-417a-aba2-cf2a38a6a068 tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f55d08c8-5289-4964-b23d-2fb02b1bb7c5 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:44 devstack sudo[89010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f55d08c8-5289-4964-b23d-2fb02b1bb7c5 Apr 24 13:53:44 devstack sudo[89010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:45 devstack sudo[89008]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ebf6feb9-dd39-4c6b-b4aa-02703538a75f tempest-VolumesExtendTest-1283463981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c728b873-eb17-44a1-8003-76dfa473f2a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c728b873-eb17-44a1-8003-76dfa473f2a4.f3c42b5a-76d8-49eb-b032-40bc060dede6 1G" returned: 0 in 0.727s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ebf6feb9-dd39-4c6b-b4aa-02703538a75f tempest-VolumesExtendTest-1283463981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c728b873-eb17-44a1-8003-76dfa473f2a4 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c728b873-eb17-44a1-8003-76dfa473f2a4.f3c42b5a-76d8-49eb-b032-40bc060dede6 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:45 devstack sudo[89017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c728b873-eb17-44a1-8003-76dfa473f2a4 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c728b873-eb17-44a1-8003-76dfa473f2a4.f3c42b5a-76d8-49eb-b032-40bc060dede6 Apr 24 13:53:45 devstack sudo[89017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:45 devstack sudo[89010]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4d91643c-878c-417a-aba2-cf2a38a6a068 tempest-VolumesSnapshotTestJSON-952003017 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f55d08c8-5289-4964-b23d-2fb02b1bb7c5" returned: 0 in 0.661s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4d91643c-878c-417a-aba2-cf2a38a6a068 tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f55d08c8-5289-4964-b23d-2fb02b1bb7c5 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:45 devstack sudo[89020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f55d08c8-5289-4964-b23d-2fb02b1bb7c5 Apr 24 13:53:45 devstack sudo[89020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:45 devstack sudo[89017]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ebf6feb9-dd39-4c6b-b4aa-02703538a75f tempest-VolumesExtendTest-1283463981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c728b873-eb17-44a1-8003-76dfa473f2a4 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c728b873-eb17-44a1-8003-76dfa473f2a4.f3c42b5a-76d8-49eb-b032-40bc060dede6" returned: 0 in 0.609s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:45 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-ebf6feb9-dd39-4c6b-b4aa-02703538a75f tempest-VolumesExtendTest-1283463981 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c728b873-eb17-44a1-8003-76dfa473f2a4.f3c42b5a-76d8-49eb-b032-40bc060dede6 is being set with open permissions: ugo+rw Apr 24 13:53:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ebf6feb9-dd39-4c6b-b4aa-02703538a75f tempest-VolumesExtendTest-1283463981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c728b873-eb17-44a1-8003-76dfa473f2a4.f3c42b5a-76d8-49eb-b032-40bc060dede6 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:45 devstack sudo[89027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c728b873-eb17-44a1-8003-76dfa473f2a4.f3c42b5a-76d8-49eb-b032-40bc060dede6 Apr 24 13:53:45 devstack sudo[89027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:45 devstack sudo[89020]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4d91643c-878c-417a-aba2-cf2a38a6a068 tempest-VolumesSnapshotTestJSON-952003017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f55d08c8-5289-4964-b23d-2fb02b1bb7c5" returned: 0 in 0.537s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:45 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-4d91643c-878c-417a-aba2-cf2a38a6a068 tempest-VolumesSnapshotTestJSON-952003017 None] Lock "cinder-quobyte-f55d08c8-5289-4964-b23d-2fb02b1bb7c5" released by "delete_volume" :: held 1.247s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:53:45 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-4d91643c-878c-417a-aba2-cf2a38a6a068 tempest-VolumesSnapshotTestJSON-952003017 None] Created reservations ['a045bddc-ef36-4736-ad21-fafc45876fef', 'dfa170fa-9a5c-4c12-ab49-ba1e7aec6bb0', 'd0a3c960-5f60-425e-b62a-66420667fbf8', '1822fae2-3f48-4060-88c2-62051bee2ab3'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:53:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4d91643c-878c-417a-aba2-cf2a38a6a068 tempest-VolumesSnapshotTestJSON-952003017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:53:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4d91643c-878c-417a-aba2-cf2a38a6a068 tempest-VolumesSnapshotTestJSON-952003017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:53:45 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-4d91643c-878c-417a-aba2-cf2a38a6a068 tempest-VolumesSnapshotTestJSON-952003017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:53:45 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-4d91643c-878c-417a-aba2-cf2a38a6a068 tempest-VolumesSnapshotTestJSON-952003017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:53:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4d91643c-878c-417a-aba2-cf2a38a6a068 tempest-VolumesSnapshotTestJSON-952003017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:53:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4d91643c-878c-417a-aba2-cf2a38a6a068 tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:45 devstack sudo[89029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:53:45 devstack sudo[89029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:46 devstack sudo[89027]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:46 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ebf6feb9-dd39-4c6b-b4aa-02703538a75f tempest-VolumesExtendTest-1283463981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c728b873-eb17-44a1-8003-76dfa473f2a4.f3c42b5a-76d8-49eb-b032-40bc060dede6" returned: 0 in 0.551s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:46 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ebf6feb9-dd39-4c6b-b4aa-02703538a75f tempest-VolumesExtendTest-1283463981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c728b873-eb17-44a1-8003-76dfa473f2a4.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:46 devstack sudo[89033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c728b873-eb17-44a1-8003-76dfa473f2a4.info Apr 24 13:53:46 devstack sudo[89033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:46 devstack sudo[89029]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:46 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4d91643c-878c-417a-aba2-cf2a38a6a068 tempest-VolumesSnapshotTestJSON-952003017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.491s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:46 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-4d91643c-878c-417a-aba2-cf2a38a6a068 tempest-VolumesSnapshotTestJSON-952003017 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:53:46 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-4d91643c-878c-417a-aba2-cf2a38a6a068 tempest-VolumesSnapshotTestJSON-952003017 None] Deleted volume successfully. Apr 24 13:53:46 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-4d91643c-878c-417a-aba2-cf2a38a6a068 tempest-VolumesSnapshotTestJSON-952003017 None] Lock "cinder-f55d08c8-5289-4964-b23d-2fb02b1bb7c5-delete_volume" released by "delete_volume" :: held 1.983s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:53:46 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc82df51-d3c4-4989-a417-c27d6b7ae25a tempest-VolumeTypesAccessTest-235218746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:53:46 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-fc82df51-d3c4-4989-a417-c27d6b7ae25a tempest-VolumeTypesAccessTest-235218746 None] Flow 'volume_create_manager' (210d7427-21e4-4320-8ec2-23266b7c6ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:53:46 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-fc82df51-d3c4-4989-a417-c27d6b7ae25a tempest-VolumeTypesAccessTest-235218746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7dd0aba-9f4a-4114-8b83-36166245f001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:53:46 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-fc82df51-d3c4-4989-a417-c27d6b7ae25a tempest-VolumeTypesAccessTest-235218746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7dd0aba-9f4a-4114-8b83-36166245f001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-195620653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bde1e64-756d-40a9-a144-00148007faab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f54e6e1831ca48968f6e46e5f3781e67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:53:47Z,use_quota=True,user_id='2812b124cda04cbf97b21500125a0abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c3db54-4022-41dc-85d3-8a32b9ebf35f),volume_type_id=05c3db54-4022-41dc-85d3-8a32b9ebf35f)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:53:46 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-fc82df51-d3c4-4989-a417-c27d6b7ae25a tempest-VolumeTypesAccessTest-235218746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2be3a3b-94e2-4f12-bd9b-94701d6bba36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:53:46 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-fc82df51-d3c4-4989-a417-c27d6b7ae25a tempest-VolumeTypesAccessTest-235218746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2be3a3b-94e2-4f12-bd9b-94701d6bba36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:53:46 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-fc82df51-d3c4-4989-a417-c27d6b7ae25a tempest-VolumeTypesAccessTest-235218746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b3f449f-e7c5-4b0e-84ea-de6a9aafd6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:53:46 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-fc82df51-d3c4-4989-a417-c27d6b7ae25a tempest-VolumeTypesAccessTest-235218746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b3f449f-e7c5-4b0e-84ea-de6a9aafd6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bde1e64-756d-40a9-a144-00148007faab', 'volume_name': 'volume-3bde1e64-756d-40a9-a144-00148007faab', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:53:46 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-fc82df51-d3c4-4989-a417-c27d6b7ae25a tempest-VolumeTypesAccessTest-235218746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5962320-10d0-44b6-8033-8efb21e46f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:53:46 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-fc82df51-d3c4-4989-a417-c27d6b7ae25a tempest-VolumeTypesAccessTest-235218746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5962320-10d0-44b6-8033-8efb21e46f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:53:46 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-fc82df51-d3c4-4989-a417-c27d6b7ae25a tempest-VolumeTypesAccessTest-235218746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c69983b-c7ba-435e-9209-ba71c36087f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:53:46 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-fc82df51-d3c4-4989-a417-c27d6b7ae25a tempest-VolumeTypesAccessTest-235218746 None] Volume 3bde1e64-756d-40a9-a144-00148007faab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bde1e64-756d-40a9-a144-00148007faab', 'volume_size': 1} Apr 24 13:53:46 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-fc82df51-d3c4-4989-a417-c27d6b7ae25a tempest-VolumeTypesAccessTest-235218746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:53:46 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-6ac8350b-e97b-4e9a-95ec-3a7d4f4a811f tempest-VolumesSnapshotTestJSON-952003017 None] Acquiring lock "cinder-f2c01b36-c2e9-4c0c-bf2d-79d467da3269-delete_snapshot" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:53:46 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-6ac8350b-e97b-4e9a-95ec-3a7d4f4a811f tempest-VolumesSnapshotTestJSON-952003017 None] Lock "cinder-f2c01b36-c2e9-4c0c-bf2d-79d467da3269-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:53:46 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-6ac8350b-e97b-4e9a-95ec-3a7d4f4a811f tempest-VolumesSnapshotTestJSON-952003017 None] Acquiring lock "cinder-quobyte-1681d7c0-42db-4e10-9f39-221092231230" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:53:46 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-6ac8350b-e97b-4e9a-95ec-3a7d4f4a811f tempest-VolumesSnapshotTestJSON-952003017 None] Lock "cinder-quobyte-1681d7c0-42db-4e10-9f39-221092231230" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:53:46 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-6ac8350b-e97b-4e9a-95ec-3a7d4f4a811f tempest-VolumesSnapshotTestJSON-952003017 None] Acquiring lock "cinder-quobyte-f2c01b36-c2e9-4c0c-bf2d-79d467da3269" by "_delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:53:46 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-6ac8350b-e97b-4e9a-95ec-3a7d4f4a811f tempest-VolumesSnapshotTestJSON-952003017 None] Lock "cinder-quobyte-f2c01b36-c2e9-4c0c-bf2d-79d467da3269" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:53:46 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-6ac8350b-e97b-4e9a-95ec-3a7d4f4a811f tempest-VolumesSnapshotTestJSON-952003017 None] Deleting offline snapshot f2c01b36-c2e9-4c0c-bf2d-79d467da3269 of volume 1681d7c0-42db-4e10-9f39-221092231230 {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 13:53:46 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-6ac8350b-e97b-4e9a-95ec-3a7d4f4a811f tempest-VolumesSnapshotTestJSON-952003017 None] snapshot_file for this snap is: volume-1681d7c0-42db-4e10-9f39-221092231230.f2c01b36-c2e9-4c0c-bf2d-79d467da3269 {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 13:53:46 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7e6792-a060-4a6e-ac37-9de3f8b1cce6]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:53:46 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6ac8350b-e97b-4e9a-95ec-3a7d4f4a811f tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230.f2c01b36-c2e9-4c0c-bf2d-79d467da3269 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:46 devstack sudo[89033]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:46 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ebf6feb9-dd39-4c6b-b4aa-02703538a75f tempest-VolumesExtendTest-1283463981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c728b873-eb17-44a1-8003-76dfa473f2a4.info" returned: 0 in 0.594s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:46 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-ebf6feb9-dd39-4c6b-b4aa-02703538a75f tempest-VolumesExtendTest-1283463981 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c728b873-eb17-44a1-8003-76dfa473f2a4.info is being set with open permissions: ugo+rw Apr 24 13:53:46 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ebf6feb9-dd39-4c6b-b4aa-02703538a75f tempest-VolumesExtendTest-1283463981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c728b873-eb17-44a1-8003-76dfa473f2a4.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:46 devstack sudo[89036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230.f2c01b36-c2e9-4c0c-bf2d-79d467da3269 Apr 24 13:53:46 devstack sudo[89037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c728b873-eb17-44a1-8003-76dfa473f2a4.info Apr 24 13:53:46 devstack sudo[89036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:46 devstack sudo[89037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:47 devstack sudo[89037]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ebf6feb9-dd39-4c6b-b4aa-02703538a75f tempest-VolumesExtendTest-1283463981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c728b873-eb17-44a1-8003-76dfa473f2a4.info" returned: 0 in 0.459s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:47 devstack sudo[89036]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-ebf6feb9-dd39-4c6b-b4aa-02703538a75f tempest-VolumesExtendTest-1283463981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.651s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:53:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-fc82df51-d3c4-4989-a417-c27d6b7ae25a tempest-VolumeTypesAccessTest-235218746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.625s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:53:47 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-fc82df51-d3c4-4989-a417-c27d6b7ae25a tempest-VolumeTypesAccessTest-235218746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-195620653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bde1e64-756d-40a9-a144-00148007faab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f54e6e1831ca48968f6e46e5f3781e67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:53:47Z,use_quota=True,user_id='2812b124cda04cbf97b21500125a0abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c3db54-4022-41dc-85d3-8a32b9ebf35f),volume_type_id=05c3db54-4022-41dc-85d3-8a32b9ebf35f)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:53:47 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-fc82df51-d3c4-4989-a417-c27d6b7ae25a tempest-VolumeTypesAccessTest-235218746 None] Creating volume 3bde1e64-756d-40a9-a144-00148007faab {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:53:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-fc82df51-d3c4-4989-a417-c27d6b7ae25a tempest-VolumeTypesAccessTest-235218746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:53:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-fc82df51-d3c4-4989-a417-c27d6b7ae25a tempest-VolumeTypesAccessTest-235218746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:53:47 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-fc82df51-d3c4-4989-a417-c27d6b7ae25a tempest-VolumeTypesAccessTest-235218746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:53:47 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-fc82df51-d3c4-4989-a417-c27d6b7ae25a tempest-VolumeTypesAccessTest-235218746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:53:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-fc82df51-d3c4-4989-a417-c27d6b7ae25a tempest-VolumeTypesAccessTest-235218746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:53:47 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-fc82df51-d3c4-4989-a417-c27d6b7ae25a tempest-VolumeTypesAccessTest-235218746 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:53:47 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-fc82df51-d3c4-4989-a417-c27d6b7ae25a tempest-VolumeTypesAccessTest-235218746 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:53:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-fc82df51-d3c4-4989-a417-c27d6b7ae25a tempest-VolumeTypesAccessTest-235218746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-3bde1e64-756d-40a9-a144-00148007faab 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6ac8350b-e97b-4e9a-95ec-3a7d4f4a811f tempest-VolumesSnapshotTestJSON-952003017 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230.f2c01b36-c2e9-4c0c-bf2d-79d467da3269" returned: 0 in 0.564s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:47 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-6ac8350b-e97b-4e9a-95ec-3a7d4f4a811f tempest-VolumesSnapshotTestJSON-952003017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1681d7c0-42db-4e10-9f39-221092231230(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:53:47 devstack sudo[89044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-3bde1e64-756d-40a9-a144-00148007faab 1073741824 Apr 24 13:53:47 devstack sudo[89044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:47 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f07132-973e-401c-9e63-621cef313da1]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:53:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6ac8350b-e97b-4e9a-95ec-3a7d4f4a811f tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:47 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-ebf6feb9-dd39-4c6b-b4aa-02703538a75f tempest-VolumesExtendTest-1283463981 None] Create snapshot completed successfully Apr 24 13:53:47 devstack sudo[89046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230 Apr 24 13:53:47 devstack sudo[89046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:48 devstack sudo[89046]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6ac8350b-e97b-4e9a-95ec-3a7d4f4a811f tempest-VolumesSnapshotTestJSON-952003017 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230" returned: 0 in 0.578s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6ac8350b-e97b-4e9a-95ec-3a7d4f4a811f tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230.f2c01b36-c2e9-4c0c-bf2d-79d467da3269 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:48 devstack sudo[89054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230.f2c01b36-c2e9-4c0c-bf2d-79d467da3269 Apr 24 13:53:48 devstack sudo[89054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:48 devstack sudo[89044]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-fc82df51-d3c4-4989-a417-c27d6b7ae25a tempest-VolumeTypesAccessTest-235218746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-3bde1e64-756d-40a9-a144-00148007faab 1073741824" returned: 0 in 0.677s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:48 devstack cinder-volume[82046]: DEBUG dbcounter [-] [82046] Writing DB stats cinder:SELECT=107,cinder:INSERT=40,cinder:UPDATE=113,cinder:DELETE=10 {{(pid=82046) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 13:53:48 devstack cinder-volume[82046]: DEBUG dbcounter [-] [82046] Writing DB stats cinder:SELECT=109,cinder:INSERT=34,cinder:UPDATE=129,cinder:DELETE=10 {{(pid=82046) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 13:53:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-fc82df51-d3c4-4989-a417-c27d6b7ae25a tempest-VolumeTypesAccessTest-235218746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-3bde1e64-756d-40a9-a144-00148007faab {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:48 devstack sudo[89056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-3bde1e64-756d-40a9-a144-00148007faab Apr 24 13:53:48 devstack sudo[89056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-40e63d19-f21d-4b32-9f23-ffb7b50eeda0 tempest-VolumesExtendTest-1283463981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:53:48 devstack sudo[89056]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:48 devstack sudo[89054]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6ac8350b-e97b-4e9a-95ec-3a7d4f4a811f tempest-VolumesSnapshotTestJSON-952003017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230.f2c01b36-c2e9-4c0c-bf2d-79d467da3269" returned: 0 in 0.605s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6ac8350b-e97b-4e9a-95ec-3a7d4f4a811f tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230.f2c01b36-c2e9-4c0c-bf2d-79d467da3269 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-fc82df51-d3c4-4989-a417-c27d6b7ae25a tempest-VolumeTypesAccessTest-235218746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-3bde1e64-756d-40a9-a144-00148007faab" returned: 0 in 0.512s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:48 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-fc82df51-d3c4-4989-a417-c27d6b7ae25a tempest-VolumeTypesAccessTest-235218746 None] <== create_volume: return (1245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:53:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-fc82df51-d3c4-4989-a417-c27d6b7ae25a tempest-VolumeTypesAccessTest-235218746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.249s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:53:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-40e63d19-f21d-4b32-9f23-ffb7b50eeda0 tempest-VolumesExtendTest-1283463981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.269s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:53:48 devstack sudo[89062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230.f2c01b36-c2e9-4c0c-bf2d-79d467da3269 Apr 24 13:53:48 devstack sudo[89062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:48 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-fc82df51-d3c4-4989-a417-c27d6b7ae25a tempest-VolumeTypesAccessTest-235218746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c69983b-c7ba-435e-9209-ba71c36087f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bde1e64-756d-40a9-a144-00148007faab', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:53:48 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-fc82df51-d3c4-4989-a417-c27d6b7ae25a tempest-VolumeTypesAccessTest-235218746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44e030b7-1f7a-46f8-ac66-ffbb717a0f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:53:48 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7f2452-125b-46cc-944d-b7516e33f0ba]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:53:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-40e63d19-f21d-4b32-9f23-ffb7b50eeda0 tempest-VolumesExtendTest-1283463981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c728b873-eb17-44a1-8003-76dfa473f2a4 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:48 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-fc82df51-d3c4-4989-a417-c27d6b7ae25a tempest-VolumeTypesAccessTest-235218746 None] Volume volume-3bde1e64-756d-40a9-a144-00148007faab (3bde1e64-756d-40a9-a144-00148007faab): created successfully Apr 24 13:53:48 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-fc82df51-d3c4-4989-a417-c27d6b7ae25a tempest-VolumeTypesAccessTest-235218746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44e030b7-1f7a-46f8-ac66-ffbb717a0f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:53:48 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-fc82df51-d3c4-4989-a417-c27d6b7ae25a tempest-VolumeTypesAccessTest-235218746 None] Flow 'volume_create_manager' (210d7427-21e4-4320-8ec2-23266b7c6ccb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:53:48 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-fc82df51-d3c4-4989-a417-c27d6b7ae25a tempest-VolumeTypesAccessTest-235218746 None] Created volume successfully. Apr 24 13:53:48 devstack sudo[89064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c728b873-eb17-44a1-8003-76dfa473f2a4 Apr 24 13:53:48 devstack sudo[89064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:49 devstack sudo[89062]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6ac8350b-e97b-4e9a-95ec-3a7d4f4a811f tempest-VolumesSnapshotTestJSON-952003017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230.f2c01b36-c2e9-4c0c-bf2d-79d467da3269" returned: 0 in 0.484s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:49 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-6ac8350b-e97b-4e9a-95ec-3a7d4f4a811f tempest-VolumesSnapshotTestJSON-952003017 None] Lock "cinder-quobyte-f2c01b36-c2e9-4c0c-bf2d-79d467da3269" released by "_delete_snapshot" :: held 2.333s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:53:49 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-6ac8350b-e97b-4e9a-95ec-3a7d4f4a811f tempest-VolumesSnapshotTestJSON-952003017 None] Lock "cinder-quobyte-1681d7c0-42db-4e10-9f39-221092231230" released by "delete_snapshot" :: held 2.359s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:53:49 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-6ac8350b-e97b-4e9a-95ec-3a7d4f4a811f tempest-VolumesSnapshotTestJSON-952003017 None] Created reservations ['98f0efb9-308c-4336-a35f-2c04bf4f6c19', 'c221de62-dc6f-48d8-9856-4fe735426cd7', '0365553a-103a-4cde-93e3-3bdb7bcf1165', '346ee83d-025a-410a-b147-8118d447a39f'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:53:49 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-6ac8350b-e97b-4e9a-95ec-3a7d4f4a811f tempest-VolumesSnapshotTestJSON-952003017 None] Delete snapshot completed successfully. Apr 24 13:53:49 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-6ac8350b-e97b-4e9a-95ec-3a7d4f4a811f tempest-VolumesSnapshotTestJSON-952003017 None] Lock "cinder-f2c01b36-c2e9-4c0c-bf2d-79d467da3269-delete_snapshot" released by "delete_snapshot" :: held 2.491s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:53:49 devstack sudo[89064]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-40e63d19-f21d-4b32-9f23-ffb7b50eeda0 tempest-VolumesExtendTest-1283463981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c728b873-eb17-44a1-8003-76dfa473f2a4" returned: 0 in 0.608s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-40e63d19-f21d-4b32-9f23-ffb7b50eeda0 tempest-VolumesExtendTest-1283463981 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c728b873-eb17-44a1-8003-76dfa473f2a4.f3c42b5a-76d8-49eb-b032-40bc060dede6 2G {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-40e63d19-f21d-4b32-9f23-ffb7b50eeda0 tempest-VolumesExtendTest-1283463981 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c728b873-eb17-44a1-8003-76dfa473f2a4.f3c42b5a-76d8-49eb-b032-40bc060dede6 2G" returned: 0 in 0.146s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-40e63d19-f21d-4b32-9f23-ffb7b50eeda0 tempest-VolumesExtendTest-1283463981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.799s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:53:49 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-40e63d19-f21d-4b32-9f23-ffb7b50eeda0 tempest-VolumesExtendTest-1283463981 None] Extend volume completed successfully. Apr 24 13:53:49 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-c44ac273-4408-4750-9cee-ae57b2adb288 tempest-VolumeTypesAccessTest-235218746 None] Acquiring lock "cinder-3bde1e64-756d-40a9-a144-00148007faab-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:53:49 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-c44ac273-4408-4750-9cee-ae57b2adb288 tempest-VolumeTypesAccessTest-235218746 None] Lock "cinder-3bde1e64-756d-40a9-a144-00148007faab-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:53:50 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-0589e604-b0a5-4a58-8694-67367486fcf4 tempest-VolumesSnapshotTestJSON-952003017 None] Acquiring lock "cinder-1681d7c0-42db-4e10-9f39-221092231230-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:53:50 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-c44ac273-4408-4750-9cee-ae57b2adb288 tempest-VolumeTypesAccessTest-235218746 None] Acquiring lock "cinder-quobyte-3bde1e64-756d-40a9-a144-00148007faab" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:53:50 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-0589e604-b0a5-4a58-8694-67367486fcf4 tempest-VolumesSnapshotTestJSON-952003017 None] Lock "cinder-1681d7c0-42db-4e10-9f39-221092231230-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:53:50 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-c44ac273-4408-4750-9cee-ae57b2adb288 tempest-VolumeTypesAccessTest-235218746 None] Lock "cinder-quobyte-3bde1e64-756d-40a9-a144-00148007faab" acquired by "delete_volume" :: waited 0.033s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:53:50 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e47f2a-72b4-4dcf-9c92-4ec61a902d73]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:53:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-c44ac273-4408-4750-9cee-ae57b2adb288 tempest-VolumeTypesAccessTest-235218746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-3bde1e64-756d-40a9-a144-00148007faab {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:50 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-0589e604-b0a5-4a58-8694-67367486fcf4 tempest-VolumesSnapshotTestJSON-952003017 None] Acquiring lock "cinder-quobyte-1681d7c0-42db-4e10-9f39-221092231230" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:53:50 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-0589e604-b0a5-4a58-8694-67367486fcf4 tempest-VolumesSnapshotTestJSON-952003017 None] Lock "cinder-quobyte-1681d7c0-42db-4e10-9f39-221092231230" acquired by "delete_volume" :: waited 0.019s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:53:50 devstack sudo[89079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-3bde1e64-756d-40a9-a144-00148007faab Apr 24 13:53:50 devstack sudo[89079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:50 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[c924c67d-c37b-48fb-b21d-1820876ef2b3]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:53:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0589e604-b0a5-4a58-8694-67367486fcf4 tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:50 devstack sudo[89081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230 Apr 24 13:53:50 devstack sudo[89081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:50 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-4f65e539-9418-41f3-9015-5afcadc5b404 tempest-VolumesExtendTest-1283463981 None] Acquiring lock "cinder-f3c42b5a-76d8-49eb-b032-40bc060dede6-delete_snapshot" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:53:50 devstack sudo[89079]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-c44ac273-4408-4750-9cee-ae57b2adb288 tempest-VolumeTypesAccessTest-235218746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-3bde1e64-756d-40a9-a144-00148007faab" returned: 0 in 0.611s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-c44ac273-4408-4750-9cee-ae57b2adb288 tempest-VolumeTypesAccessTest-235218746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-3bde1e64-756d-40a9-a144-00148007faab {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:50 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-4f65e539-9418-41f3-9015-5afcadc5b404 tempest-VolumesExtendTest-1283463981 None] Lock "cinder-f3c42b5a-76d8-49eb-b032-40bc060dede6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:53:50 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-4f65e539-9418-41f3-9015-5afcadc5b404 tempest-VolumesExtendTest-1283463981 None] Acquiring lock "cinder-quobyte-c728b873-eb17-44a1-8003-76dfa473f2a4" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:53:50 devstack sudo[89088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-3bde1e64-756d-40a9-a144-00148007faab Apr 24 13:53:50 devstack sudo[89088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:50 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-4f65e539-9418-41f3-9015-5afcadc5b404 tempest-VolumesExtendTest-1283463981 None] Lock "cinder-quobyte-c728b873-eb17-44a1-8003-76dfa473f2a4" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:53:50 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-4f65e539-9418-41f3-9015-5afcadc5b404 tempest-VolumesExtendTest-1283463981 None] Acquiring lock "cinder-quobyte-f3c42b5a-76d8-49eb-b032-40bc060dede6" by "_delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:53:50 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-4f65e539-9418-41f3-9015-5afcadc5b404 tempest-VolumesExtendTest-1283463981 None] Lock "cinder-quobyte-f3c42b5a-76d8-49eb-b032-40bc060dede6" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:53:50 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-4f65e539-9418-41f3-9015-5afcadc5b404 tempest-VolumesExtendTest-1283463981 None] Deleting offline snapshot f3c42b5a-76d8-49eb-b032-40bc060dede6 of volume c728b873-eb17-44a1-8003-76dfa473f2a4 {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 13:53:50 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-4f65e539-9418-41f3-9015-5afcadc5b404 tempest-VolumesExtendTest-1283463981 None] snapshot_file for this snap is: volume-c728b873-eb17-44a1-8003-76dfa473f2a4.f3c42b5a-76d8-49eb-b032-40bc060dede6 {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 13:53:50 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[737f9ccd-1ac3-42ef-bbfe-3e52933026b1]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:53:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4f65e539-9418-41f3-9015-5afcadc5b404 tempest-VolumesExtendTest-1283463981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c728b873-eb17-44a1-8003-76dfa473f2a4.f3c42b5a-76d8-49eb-b032-40bc060dede6 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:50 devstack sudo[89081]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0589e604-b0a5-4a58-8694-67367486fcf4 tempest-VolumesSnapshotTestJSON-952003017 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230" returned: 0 in 0.677s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0589e604-b0a5-4a58-8694-67367486fcf4 tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:50 devstack sudo[89091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c728b873-eb17-44a1-8003-76dfa473f2a4.f3c42b5a-76d8-49eb-b032-40bc060dede6 Apr 24 13:53:50 devstack sudo[89091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:50 devstack sudo[89092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230 Apr 24 13:53:50 devstack sudo[89092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:51 devstack sudo[89088]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-c44ac273-4408-4750-9cee-ae57b2adb288 tempest-VolumeTypesAccessTest-235218746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-3bde1e64-756d-40a9-a144-00148007faab" returned: 0 in 0.598s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:51 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-c44ac273-4408-4750-9cee-ae57b2adb288 tempest-VolumeTypesAccessTest-235218746 None] Lock "cinder-quobyte-3bde1e64-756d-40a9-a144-00148007faab" released by "delete_volume" :: held 1.286s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:53:51 devstack cinder-volume[82046]: WARNING cinder.quota [None req-c44ac273-4408-4750-9cee-ae57b2adb288 tempest-VolumeTypesAccessTest-235218746 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1388728321 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1388728321, it is now deprecated. Please use the default quota class for default quota. Apr 24 13:53:51 devstack cinder-volume[82046]: WARNING cinder.quota [None req-c44ac273-4408-4750-9cee-ae57b2adb288 tempest-VolumeTypesAccessTest-235218746 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1388728321 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1388728321, it is now deprecated. Please use the default quota class for default quota. Apr 24 13:53:51 devstack sudo[89092]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0589e604-b0a5-4a58-8694-67367486fcf4 tempest-VolumesSnapshotTestJSON-952003017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1681d7c0-42db-4e10-9f39-221092231230" returned: 0 in 0.511s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:51 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-c44ac273-4408-4750-9cee-ae57b2adb288 tempest-VolumeTypesAccessTest-235218746 None] Created reservations ['41ac7e86-d774-4c5b-a7c1-d7038697a87a', '74acedb3-2456-4a89-8468-205d94de0fec', '88eebad3-e4c7-43e1-aaf6-8e923f9912aa', '2f556634-c203-4e0e-b830-977314c17b96'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:53:51 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-0589e604-b0a5-4a58-8694-67367486fcf4 tempest-VolumesSnapshotTestJSON-952003017 None] Lock "cinder-quobyte-1681d7c0-42db-4e10-9f39-221092231230" released by "delete_volume" :: held 1.280s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:53:51 devstack sudo[89091]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4f65e539-9418-41f3-9015-5afcadc5b404 tempest-VolumesExtendTest-1283463981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c728b873-eb17-44a1-8003-76dfa473f2a4.f3c42b5a-76d8-49eb-b032-40bc060dede6" returned: 0 in 0.632s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:51 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-4f65e539-9418-41f3-9015-5afcadc5b404 tempest-VolumesExtendTest-1283463981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c728b873-eb17-44a1-8003-76dfa473f2a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:53:51 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[a960e054-29a3-4181-a3f5-05e0caf68709]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:53:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4f65e539-9418-41f3-9015-5afcadc5b404 tempest-VolumesExtendTest-1283463981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c728b873-eb17-44a1-8003-76dfa473f2a4 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-c44ac273-4408-4750-9cee-ae57b2adb288 tempest-VolumeTypesAccessTest-235218746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:53:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-c44ac273-4408-4750-9cee-ae57b2adb288 tempest-VolumeTypesAccessTest-235218746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:53:51 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-c44ac273-4408-4750-9cee-ae57b2adb288 tempest-VolumeTypesAccessTest-235218746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:53:51 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-c44ac273-4408-4750-9cee-ae57b2adb288 tempest-VolumeTypesAccessTest-235218746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:53:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-c44ac273-4408-4750-9cee-ae57b2adb288 tempest-VolumeTypesAccessTest-235218746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:53:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-c44ac273-4408-4750-9cee-ae57b2adb288 tempest-VolumeTypesAccessTest-235218746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:51 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-0589e604-b0a5-4a58-8694-67367486fcf4 tempest-VolumesSnapshotTestJSON-952003017 None] Created reservations ['e51c1936-355e-47f9-b0d5-56dd8b99483a', 'fdc21543-4868-475d-876b-d9cc433713f8', '5b583f16-9b3f-428c-b485-ac22b74ebabd', 'adfdfecd-ca11-4e67-ab80-6a489d61b421'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:53:51 devstack sudo[89100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c728b873-eb17-44a1-8003-76dfa473f2a4 Apr 24 13:53:51 devstack sudo[89100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:51 devstack sudo[89101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:53:51 devstack sudo[89101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0589e604-b0a5-4a58-8694-67367486fcf4 tempest-VolumesSnapshotTestJSON-952003017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:53:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0589e604-b0a5-4a58-8694-67367486fcf4 tempest-VolumesSnapshotTestJSON-952003017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:53:51 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-0589e604-b0a5-4a58-8694-67367486fcf4 tempest-VolumesSnapshotTestJSON-952003017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:53:51 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-0589e604-b0a5-4a58-8694-67367486fcf4 tempest-VolumesSnapshotTestJSON-952003017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:53:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0589e604-b0a5-4a58-8694-67367486fcf4 tempest-VolumesSnapshotTestJSON-952003017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:53:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0589e604-b0a5-4a58-8694-67367486fcf4 tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:51 devstack sudo[89104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:53:51 devstack sudo[89104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:52 devstack sudo[89100]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:52 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4f65e539-9418-41f3-9015-5afcadc5b404 tempest-VolumesExtendTest-1283463981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c728b873-eb17-44a1-8003-76dfa473f2a4" returned: 0 in 0.612s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:52 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4f65e539-9418-41f3-9015-5afcadc5b404 tempest-VolumesExtendTest-1283463981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c728b873-eb17-44a1-8003-76dfa473f2a4.f3c42b5a-76d8-49eb-b032-40bc060dede6 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:52 devstack sudo[89101]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:52 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-c44ac273-4408-4750-9cee-ae57b2adb288 tempest-VolumeTypesAccessTest-235218746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.575s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:52 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-c44ac273-4408-4750-9cee-ae57b2adb288 tempest-VolumeTypesAccessTest-235218746 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:53:52 devstack sudo[89111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c728b873-eb17-44a1-8003-76dfa473f2a4.f3c42b5a-76d8-49eb-b032-40bc060dede6 Apr 24 13:53:52 devstack sudo[89111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:52 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-c44ac273-4408-4750-9cee-ae57b2adb288 tempest-VolumeTypesAccessTest-235218746 None] Deleted volume successfully. Apr 24 13:53:52 devstack sudo[89104]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:52 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-c44ac273-4408-4750-9cee-ae57b2adb288 tempest-VolumeTypesAccessTest-235218746 None] Lock "cinder-3bde1e64-756d-40a9-a144-00148007faab-delete_volume" released by "delete_volume" :: held 2.243s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:53:52 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0589e604-b0a5-4a58-8694-67367486fcf4 tempest-VolumesSnapshotTestJSON-952003017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.526s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:52 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-0589e604-b0a5-4a58-8694-67367486fcf4 tempest-VolumesSnapshotTestJSON-952003017 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:53:52 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-0589e604-b0a5-4a58-8694-67367486fcf4 tempest-VolumesSnapshotTestJSON-952003017 None] Deleted volume successfully. Apr 24 13:53:52 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-0589e604-b0a5-4a58-8694-67367486fcf4 tempest-VolumesSnapshotTestJSON-952003017 None] Lock "cinder-1681d7c0-42db-4e10-9f39-221092231230-delete_volume" released by "delete_volume" :: held 2.195s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:53:52 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-7ce55a3b-2ffc-47d1-a6a8-dd27f5a7af7b tempest-VolumesSnapshotTestJSON-952003017 None] Acquiring lock "cinder-78f402c7-4a8d-428f-ac00-20d12c72157d-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:53:52 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-7ce55a3b-2ffc-47d1-a6a8-dd27f5a7af7b tempest-VolumesSnapshotTestJSON-952003017 None] Lock "cinder-78f402c7-4a8d-428f-ac00-20d12c72157d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:53:52 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-7ce55a3b-2ffc-47d1-a6a8-dd27f5a7af7b tempest-VolumesSnapshotTestJSON-952003017 None] Acquiring lock "cinder-quobyte-78f402c7-4a8d-428f-ac00-20d12c72157d" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:53:52 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-7ce55a3b-2ffc-47d1-a6a8-dd27f5a7af7b tempest-VolumesSnapshotTestJSON-952003017 None] Lock "cinder-quobyte-78f402c7-4a8d-428f-ac00-20d12c72157d" acquired by "delete_volume" :: waited 0.024s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:53:52 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b4d1b9-6feb-44c2-9be3-a113abbacace]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:53:52 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7ce55a3b-2ffc-47d1-a6a8-dd27f5a7af7b tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-78f402c7-4a8d-428f-ac00-20d12c72157d {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:52 devstack sudo[89113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-78f402c7-4a8d-428f-ac00-20d12c72157d Apr 24 13:53:52 devstack sudo[89113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:52 devstack sudo[89111]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:52 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4f65e539-9418-41f3-9015-5afcadc5b404 tempest-VolumesExtendTest-1283463981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c728b873-eb17-44a1-8003-76dfa473f2a4.f3c42b5a-76d8-49eb-b032-40bc060dede6" returned: 0 in 0.693s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:52 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4f65e539-9418-41f3-9015-5afcadc5b404 tempest-VolumesExtendTest-1283463981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c728b873-eb17-44a1-8003-76dfa473f2a4.f3c42b5a-76d8-49eb-b032-40bc060dede6 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:52 devstack sudo[89118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c728b873-eb17-44a1-8003-76dfa473f2a4.f3c42b5a-76d8-49eb-b032-40bc060dede6 Apr 24 13:53:52 devstack sudo[89118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:53 devstack sudo[89113]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7ce55a3b-2ffc-47d1-a6a8-dd27f5a7af7b tempest-VolumesSnapshotTestJSON-952003017 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-78f402c7-4a8d-428f-ac00-20d12c72157d" returned: 0 in 0.709s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7ce55a3b-2ffc-47d1-a6a8-dd27f5a7af7b tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-78f402c7-4a8d-428f-ac00-20d12c72157d {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:53 devstack sudo[89123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-78f402c7-4a8d-428f-ac00-20d12c72157d Apr 24 13:53:53 devstack sudo[89123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:53 devstack sudo[89118]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4f65e539-9418-41f3-9015-5afcadc5b404 tempest-VolumesExtendTest-1283463981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c728b873-eb17-44a1-8003-76dfa473f2a4.f3c42b5a-76d8-49eb-b032-40bc060dede6" returned: 0 in 0.610s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:53 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-4f65e539-9418-41f3-9015-5afcadc5b404 tempest-VolumesExtendTest-1283463981 None] Lock "cinder-quobyte-f3c42b5a-76d8-49eb-b032-40bc060dede6" released by "_delete_snapshot" :: held 2.676s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:53:53 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-4f65e539-9418-41f3-9015-5afcadc5b404 tempest-VolumesExtendTest-1283463981 None] Lock "cinder-quobyte-c728b873-eb17-44a1-8003-76dfa473f2a4" released by "delete_snapshot" :: held 2.713s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:53:53 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-4f65e539-9418-41f3-9015-5afcadc5b404 tempest-VolumesExtendTest-1283463981 None] Created reservations ['2f92b731-223e-4698-a02a-901710ff3eee', '48a10335-9dad-487a-b141-6180f95185c9', 'a64ea710-356f-48eb-b9b4-0b6f0c1e56aa', 'd61cf776-3d82-4551-85cd-b92a66811b75'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:53:53 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-4f65e539-9418-41f3-9015-5afcadc5b404 tempest-VolumesExtendTest-1283463981 None] Delete snapshot completed successfully. Apr 24 13:53:53 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-4f65e539-9418-41f3-9015-5afcadc5b404 tempest-VolumesExtendTest-1283463981 None] Lock "cinder-f3c42b5a-76d8-49eb-b032-40bc060dede6-delete_snapshot" released by "delete_snapshot" :: held 2.912s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:53:53 devstack sudo[89123]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7ce55a3b-2ffc-47d1-a6a8-dd27f5a7af7b tempest-VolumesSnapshotTestJSON-952003017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-78f402c7-4a8d-428f-ac00-20d12c72157d" returned: 0 in 0.540s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:53 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-7ce55a3b-2ffc-47d1-a6a8-dd27f5a7af7b tempest-VolumesSnapshotTestJSON-952003017 None] Lock "cinder-quobyte-78f402c7-4a8d-428f-ac00-20d12c72157d" released by "delete_volume" :: held 1.331s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:53:53 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-7ce55a3b-2ffc-47d1-a6a8-dd27f5a7af7b tempest-VolumesSnapshotTestJSON-952003017 None] Created reservations ['3dd122f7-2693-4be4-9f26-aa8e50878a5e', '41addf35-5031-4bd6-9f5c-d2863378e213', '06491c7f-221a-48d8-8db2-417dfe84dd20', '0515efef-3ecf-4f39-b710-76b525944f72'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:53:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-7ce55a3b-2ffc-47d1-a6a8-dd27f5a7af7b tempest-VolumesSnapshotTestJSON-952003017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:53:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-7ce55a3b-2ffc-47d1-a6a8-dd27f5a7af7b tempest-VolumesSnapshotTestJSON-952003017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:53:53 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-7ce55a3b-2ffc-47d1-a6a8-dd27f5a7af7b tempest-VolumesSnapshotTestJSON-952003017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:53:53 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-7ce55a3b-2ffc-47d1-a6a8-dd27f5a7af7b tempest-VolumesSnapshotTestJSON-952003017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:53:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-7ce55a3b-2ffc-47d1-a6a8-dd27f5a7af7b tempest-VolumesSnapshotTestJSON-952003017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:53:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7ce55a3b-2ffc-47d1-a6a8-dd27f5a7af7b tempest-VolumesSnapshotTestJSON-952003017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:54 devstack sudo[89127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:53:54 devstack sudo[89127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:54 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-6d904ba4-69fe-42f9-98ba-f24a0e8f300b tempest-VolumesExtendTest-1283463981 None] Acquiring lock "cinder-c728b873-eb17-44a1-8003-76dfa473f2a4-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:53:54 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-6d904ba4-69fe-42f9-98ba-f24a0e8f300b tempest-VolumesExtendTest-1283463981 None] Lock "cinder-c728b873-eb17-44a1-8003-76dfa473f2a4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:53:54 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-6d904ba4-69fe-42f9-98ba-f24a0e8f300b tempest-VolumesExtendTest-1283463981 None] Acquiring lock "cinder-quobyte-c728b873-eb17-44a1-8003-76dfa473f2a4" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:53:54 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-6d904ba4-69fe-42f9-98ba-f24a0e8f300b tempest-VolumesExtendTest-1283463981 None] Lock "cinder-quobyte-c728b873-eb17-44a1-8003-76dfa473f2a4" acquired by "delete_volume" :: waited 0.016s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:53:54 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[350d7bdf-41c1-4815-89cd-0f66fafd2a17]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:53:54 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6d904ba4-69fe-42f9-98ba-f24a0e8f300b tempest-VolumesExtendTest-1283463981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c728b873-eb17-44a1-8003-76dfa473f2a4 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:54 devstack sudo[89129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c728b873-eb17-44a1-8003-76dfa473f2a4 Apr 24 13:53:54 devstack sudo[89129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:54 devstack sudo[89127]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:54 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7ce55a3b-2ffc-47d1-a6a8-dd27f5a7af7b tempest-VolumesSnapshotTestJSON-952003017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.571s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:54 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-7ce55a3b-2ffc-47d1-a6a8-dd27f5a7af7b tempest-VolumesSnapshotTestJSON-952003017 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:53:54 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-7ce55a3b-2ffc-47d1-a6a8-dd27f5a7af7b tempest-VolumesSnapshotTestJSON-952003017 None] Deleted volume successfully. Apr 24 13:53:54 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-7ce55a3b-2ffc-47d1-a6a8-dd27f5a7af7b tempest-VolumesSnapshotTestJSON-952003017 None] Lock "cinder-78f402c7-4a8d-428f-ac00-20d12c72157d-delete_volume" released by "delete_volume" :: held 2.152s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:53:54 devstack sudo[89129]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:54 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6d904ba4-69fe-42f9-98ba-f24a0e8f300b tempest-VolumesExtendTest-1283463981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c728b873-eb17-44a1-8003-76dfa473f2a4" returned: 0 in 0.646s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:54 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6d904ba4-69fe-42f9-98ba-f24a0e8f300b tempest-VolumesExtendTest-1283463981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c728b873-eb17-44a1-8003-76dfa473f2a4 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:54 devstack sudo[89135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c728b873-eb17-44a1-8003-76dfa473f2a4 Apr 24 13:53:54 devstack sudo[89135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:55 devstack sudo[89135]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:55 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6d904ba4-69fe-42f9-98ba-f24a0e8f300b tempest-VolumesExtendTest-1283463981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c728b873-eb17-44a1-8003-76dfa473f2a4" returned: 0 in 0.609s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:55 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-6d904ba4-69fe-42f9-98ba-f24a0e8f300b tempest-VolumesExtendTest-1283463981 None] Lock "cinder-quobyte-c728b873-eb17-44a1-8003-76dfa473f2a4" released by "delete_volume" :: held 1.343s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:53:55 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-6d904ba4-69fe-42f9-98ba-f24a0e8f300b tempest-VolumesExtendTest-1283463981 None] Created reservations ['09a17c1e-817d-44c0-8460-90100a4d7bd3', '13859e56-7d1a-4596-924f-efbd21fc7021', 'b03b0922-4be6-439e-a0fb-e7a1c7e2ba91', 'df75df33-95c4-4085-b592-7273059d099f'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:53:55 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-6d904ba4-69fe-42f9-98ba-f24a0e8f300b tempest-VolumesExtendTest-1283463981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:53:55 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-6d904ba4-69fe-42f9-98ba-f24a0e8f300b tempest-VolumesExtendTest-1283463981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:53:55 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-6d904ba4-69fe-42f9-98ba-f24a0e8f300b tempest-VolumesExtendTest-1283463981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:53:55 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-6d904ba4-69fe-42f9-98ba-f24a0e8f300b tempest-VolumesExtendTest-1283463981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:53:55 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-6d904ba4-69fe-42f9-98ba-f24a0e8f300b tempest-VolumesExtendTest-1283463981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:53:55 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6d904ba4-69fe-42f9-98ba-f24a0e8f300b tempest-VolumesExtendTest-1283463981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:53:55 devstack sudo[89139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:53:55 devstack sudo[89139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:53:56 devstack sudo[89139]: pam_unix(sudo:session): session closed for user root Apr 24 13:53:56 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6d904ba4-69fe-42f9-98ba-f24a0e8f300b tempest-VolumesExtendTest-1283463981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.580s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:53:56 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-6d904ba4-69fe-42f9-98ba-f24a0e8f300b tempest-VolumesExtendTest-1283463981 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:53:56 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-6d904ba4-69fe-42f9-98ba-f24a0e8f300b tempest-VolumesExtendTest-1283463981 None] Deleted volume successfully. Apr 24 13:53:56 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-6d904ba4-69fe-42f9-98ba-f24a0e8f300b tempest-VolumesExtendTest-1283463981 None] Lock "cinder-c728b873-eb17-44a1-8003-76dfa473f2a4-delete_volume" released by "delete_volume" :: held 2.194s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:54:05 devstack cinder-volume[82046]: DEBUG dbcounter [-] [82046] Writing DB stats cinder:SELECT=34,cinder:INSERT=17,cinder:UPDATE=54,cinder:DELETE=1 {{(pid=82046) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 13:54:06 devstack cinder-volume[82046]: DEBUG dbcounter [-] [82046] Writing DB stats cinder:UPDATE=41,cinder:DELETE=4,cinder:SELECT=32,cinder:INSERT=8 {{(pid=82046) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 13:54:08 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-f98189c8-c773-42ea-8a02-caa56b0f15cb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:54:08 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f98189c8-c773-42ea-8a02-caa56b0f15cb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Flow 'volume_create_manager' (c1f9fa9f-f690-4b07-b48d-6825bfe8d93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:54:08 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f98189c8-c773-42ea-8a02-caa56b0f15cb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f92ebc1-f558-4fdf-8e32-722924020571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:08 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f98189c8-c773-42ea-8a02-caa56b0f15cb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f92ebc1-f558-4fdf-8e32-722924020571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:54:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1134284423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e508fdd0-01f6-4754-b1a9-af4849913dc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='999b5c98cee245fc8276ae07773a5126',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:54:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:54:08Z,use_quota=True,user_id='b9ab24b40c8f4a88981b200b9cb26883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:08 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f98189c8-c773-42ea-8a02-caa56b0f15cb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8742dea-4926-41ee-a0fc-8e329ad781b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:08 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f98189c8-c773-42ea-8a02-caa56b0f15cb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8742dea-4926-41ee-a0fc-8e329ad781b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:08 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f98189c8-c773-42ea-8a02-caa56b0f15cb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5415074-3ea3-450e-a957-16e790a8e76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:08 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f98189c8-c773-42ea-8a02-caa56b0f15cb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5415074-3ea3-450e-a957-16e790a8e76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e508fdd0-01f6-4754-b1a9-af4849913dc9', 'volume_name': 'volume-e508fdd0-01f6-4754-b1a9-af4849913dc9', 'volume_size': 2}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:08 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f98189c8-c773-42ea-8a02-caa56b0f15cb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ce41803-7f4f-4d8d-9928-35041f72b1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:08 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f98189c8-c773-42ea-8a02-caa56b0f15cb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ce41803-7f4f-4d8d-9928-35041f72b1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:08 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f98189c8-c773-42ea-8a02-caa56b0f15cb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc07a35e-5638-4065-995f-4478985bba85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:08 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-f98189c8-c773-42ea-8a02-caa56b0f15cb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Volume e508fdd0-01f6-4754-b1a9-af4849913dc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e508fdd0-01f6-4754-b1a9-af4849913dc9', 'volume_size': 2} Apr 24 13:54:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f98189c8-c773-42ea-8a02-caa56b0f15cb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:54:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f98189c8-c773-42ea-8a02-caa56b0f15cb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:54:08 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-f98189c8-c773-42ea-8a02-caa56b0f15cb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:54:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1134284423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e508fdd0-01f6-4754-b1a9-af4849913dc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='999b5c98cee245fc8276ae07773a5126',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:54:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:54:08Z,use_quota=True,user_id='b9ab24b40c8f4a88981b200b9cb26883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:54:08 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-f98189c8-c773-42ea-8a02-caa56b0f15cb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Creating volume e508fdd0-01f6-4754-b1a9-af4849913dc9 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:54:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f98189c8-c773-42ea-8a02-caa56b0f15cb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:54:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f98189c8-c773-42ea-8a02-caa56b0f15cb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:54:08 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-f98189c8-c773-42ea-8a02-caa56b0f15cb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:54:08 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-f98189c8-c773-42ea-8a02-caa56b0f15cb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:54:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f98189c8-c773-42ea-8a02-caa56b0f15cb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:54:08 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-f98189c8-c773-42ea-8a02-caa56b0f15cb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:54:08 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-f98189c8-c773-42ea-8a02-caa56b0f15cb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:54:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f98189c8-c773-42ea-8a02-caa56b0f15cb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e508fdd0-01f6-4754-b1a9-af4849913dc9 2147483648 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:08 devstack sudo[89147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e508fdd0-01f6-4754-b1a9-af4849913dc9 2147483648 Apr 24 13:54:08 devstack sudo[89147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:09 devstack sudo[89147]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f98189c8-c773-42ea-8a02-caa56b0f15cb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e508fdd0-01f6-4754-b1a9-af4849913dc9 2147483648" returned: 0 in 0.827s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f98189c8-c773-42ea-8a02-caa56b0f15cb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e508fdd0-01f6-4754-b1a9-af4849913dc9 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:09 devstack sudo[89152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e508fdd0-01f6-4754-b1a9-af4849913dc9 Apr 24 13:54:09 devstack sudo[89152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:10 devstack sudo[89152]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:10 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f98189c8-c773-42ea-8a02-caa56b0f15cb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e508fdd0-01f6-4754-b1a9-af4849913dc9" returned: 0 in 0.634s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:10 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-f98189c8-c773-42ea-8a02-caa56b0f15cb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:54:10 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f98189c8-c773-42ea-8a02-caa56b0f15cb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:54:10 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f98189c8-c773-42ea-8a02-caa56b0f15cb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc07a35e-5638-4065-995f-4478985bba85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e508fdd0-01f6-4754-b1a9-af4849913dc9', 'volume_size': 2}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:10 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f98189c8-c773-42ea-8a02-caa56b0f15cb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3857eab-2137-477b-ae6b-44c0960348d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:10 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-f98189c8-c773-42ea-8a02-caa56b0f15cb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Volume volume-e508fdd0-01f6-4754-b1a9-af4849913dc9 (e508fdd0-01f6-4754-b1a9-af4849913dc9): created successfully Apr 24 13:54:10 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f98189c8-c773-42ea-8a02-caa56b0f15cb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3857eab-2137-477b-ae6b-44c0960348d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:10 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f98189c8-c773-42ea-8a02-caa56b0f15cb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Flow 'volume_create_manager' (c1f9fa9f-f690-4b07-b48d-6825bfe8d93a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:54:10 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-f98189c8-c773-42ea-8a02-caa56b0f15cb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Created volume successfully. Apr 24 13:54:10 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:54:10 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] Flow 'volume_create_manager' (c5506268-2bc1-4290-96a4-72d3f83c6e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:54:10 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46f288fc-633a-4ca1-bd66-aa2c9b08f01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:10 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46f288fc-633a-4ca1-bd66-aa2c9b08f01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:54:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2110536533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91555f81-717b-43a9-88de-cd288fb63401,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecb99be5e8b7442b861e395c1120837d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:54:10Z,use_quota=True,user_id='523fde7f25bb48cb8d4d69d1b415e4dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:10 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99a23ca4-6591-4b5e-bf37-3b47e658fe67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:10 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99a23ca4-6591-4b5e-bf37-3b47e658fe67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:10 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5e14b5c-9928-4952-97aa-bf03c1c94de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:10 devstack cinder-volume[82046]: DEBUG cinder.image.glance [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] Creating Keystone auth plugin from conf {{(pid=82046) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 24 13:54:10 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5e14b5c-9928-4952-97aa-bf03c1c94de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '91555f81-717b-43a9-88de-cd288fb63401', 'volume_name': 'volume-91555f81-717b-43a9-88de-cd288fb63401', 'volume_size': 1, 'image_id': '02b8aec0-dc1c-4b93-81c4-ab6b88d472d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02b8aec0-dc1c-4b93-81c4-ab6b88d472d9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db6d5b1c41254596bd8bad1e5f7bec28', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02b8aec0-dc1c-4b93-81c4-ab6b88d472d9', 'created_at': datetime.datetime(2026, 4, 24, 11, 39, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 11, 39, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02b8aec0-dc1c-4b93-81c4-ab6b88d472d9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:10 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6471ffa5-8bc9-47cf-adbc-0c192d8ba510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:10 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6471ffa5-8bc9-47cf-adbc-0c192d8ba510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:10 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9461104b-cb16-46d8-971e-d1cdb9588524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:10 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] Volume 91555f81-717b-43a9-88de-cd288fb63401: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-91555f81-717b-43a9-88de-cd288fb63401', 'volume_size': 1, 'image_id': '02b8aec0-dc1c-4b93-81c4-ab6b88d472d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02b8aec0-dc1c-4b93-81c4-ab6b88d472d9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db6d5b1c41254596bd8bad1e5f7bec28', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02b8aec0-dc1c-4b93-81c4-ab6b88d472d9', 'created_at': datetime.datetime(2026, 4, 24, 11, 39, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 11, 39, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02b8aec0-dc1c-4b93-81c4-ab6b88d472d9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 24 13:54:10 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] Trying to clone 91555f81-717b-43a9-88de-cd288fb63401 from image 02b8aec0-dc1c-4b93-81c4-ab6b88d472d9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/02b8aec0-dc1c-4b93-81c4-ab6b88d472d9', 'metadata': {}}]). {{(pid=82046) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 24 13:54:10 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-cbad452f-cf20-41c8-9a03-b546d1c2eada tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:54:10 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-cbad452f-cf20-41c8-9a03-b546d1c2eada tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:54:10 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-cbad452f-cf20-41c8-9a03-b546d1c2eada tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Creating offline snapshot aa4d81ce-ac1e-4520-aef8-7368b57a463f of volume e508fdd0-01f6-4754-b1a9-af4849913dc9 {{(pid=82046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 13:54:10 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[670a95bc-bebe-4297-a93e-28744785fc22]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:54:10 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-cbad452f-cf20-41c8-9a03-b546d1c2eada tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e508fdd0-01f6-4754-b1a9-af4849913dc9 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:11 devstack sudo[89155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e508fdd0-01f6-4754-b1a9-af4849913dc9 Apr 24 13:54:11 devstack sudo[89155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:11 devstack cinder-volume[82046]: DEBUG cinder.image.image_utils [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_qd43acdndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82046) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 24 13:54:11 devstack cinder-volume[82046]: INFO cinder.image.image_utils [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] Image download 20.69 MB at 20.69 MB/s Apr 24 13:54:11 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[456eca17-f398-49ec-81c4-92202d6f5b90]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:54:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_qd43acdndevstack@QuobyteHD {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:11 devstack sudo[89158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_qd43acdndevstack@QuobyteHD Apr 24 13:54:11 devstack sudo[89158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:11 devstack sudo[89155]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-cbad452f-cf20-41c8-9a03-b546d1c2eada tempest-VolumesSnapshotNegativeTestJSON-840724784 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e508fdd0-01f6-4754-b1a9-af4849913dc9" returned: 0 in 0.945s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-cbad452f-cf20-41c8-9a03-b546d1c2eada tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e508fdd0-01f6-4754-b1a9-af4849913dc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e508fdd0-01f6-4754-b1a9-af4849913dc9.aa4d81ce-ac1e-4520-aef8-7368b57a463f 2G {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:11 devstack sudo[89158]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_qd43acdndevstack@QuobyteHD" returned: 0 in 0.695s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:11 devstack cinder-volume[82046]: DEBUG cinder.image.image_utils [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] Temporary image 02b8aec0-dc1c-4b93-81c4-ab6b88d472d9 is fetched for user 523fde7f25bb48cb8d4d69d1b415e4dc. {{(pid=82046) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 24 13:54:11 devstack sudo[89166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e508fdd0-01f6-4754-b1a9-af4849913dc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e508fdd0-01f6-4754-b1a9-af4849913dc9.aa4d81ce-ac1e-4520-aef8-7368b57a463f 2G Apr 24 13:54:11 devstack sudo[89166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:11 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69cd752-c775-4317-a794-3a7e76c36085]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:54:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_qd43acdndevstack@QuobyteHD {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:12 devstack sudo[89168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_qd43acdndevstack@QuobyteHD Apr 24 13:54:12 devstack sudo[89168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:12 devstack sudo[89168]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_qd43acdndevstack@QuobyteHD" returned: 0 in 0.605s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:54:12 devstack sudo[89166]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-cbad452f-cf20-41c8-9a03-b546d1c2eada tempest-VolumesSnapshotNegativeTestJSON-840724784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e508fdd0-01f6-4754-b1a9-af4849913dc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e508fdd0-01f6-4754-b1a9-af4849913dc9.aa4d81ce-ac1e-4520-aef8-7368b57a463f 2G" returned: 0 in 0.752s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-cbad452f-cf20-41c8-9a03-b546d1c2eada tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e508fdd0-01f6-4754-b1a9-af4849913dc9 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e508fdd0-01f6-4754-b1a9-af4849913dc9.aa4d81ce-ac1e-4520-aef8-7368b57a463f {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:12 devstack sudo[89176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e508fdd0-01f6-4754-b1a9-af4849913dc9 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e508fdd0-01f6-4754-b1a9-af4849913dc9.aa4d81ce-ac1e-4520-aef8-7368b57a463f Apr 24 13:54:12 devstack sudo[89176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:13 devstack sudo[89176]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-cbad452f-cf20-41c8-9a03-b546d1c2eada tempest-VolumesSnapshotNegativeTestJSON-840724784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e508fdd0-01f6-4754-b1a9-af4849913dc9 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e508fdd0-01f6-4754-b1a9-af4849913dc9.aa4d81ce-ac1e-4520-aef8-7368b57a463f" returned: 0 in 0.598s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:13 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-cbad452f-cf20-41c8-9a03-b546d1c2eada tempest-VolumesSnapshotNegativeTestJSON-840724784 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e508fdd0-01f6-4754-b1a9-af4849913dc9.aa4d81ce-ac1e-4520-aef8-7368b57a463f is being set with open permissions: ugo+rw Apr 24 13:54:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-cbad452f-cf20-41c8-9a03-b546d1c2eada tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e508fdd0-01f6-4754-b1a9-af4849913dc9.aa4d81ce-ac1e-4520-aef8-7368b57a463f {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:13 devstack sudo[89181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e508fdd0-01f6-4754-b1a9-af4849913dc9.aa4d81ce-ac1e-4520-aef8-7368b57a463f Apr 24 13:54:13 devstack sudo[89181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:13 devstack sudo[89181]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-cbad452f-cf20-41c8-9a03-b546d1c2eada tempest-VolumesSnapshotNegativeTestJSON-840724784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e508fdd0-01f6-4754-b1a9-af4849913dc9.aa4d81ce-ac1e-4520-aef8-7368b57a463f" returned: 0 in 0.548s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-cbad452f-cf20-41c8-9a03-b546d1c2eada tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e508fdd0-01f6-4754-b1a9-af4849913dc9.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:13 devstack sudo[89184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e508fdd0-01f6-4754-b1a9-af4849913dc9.info Apr 24 13:54:13 devstack sudo[89184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:14 devstack sudo[89184]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-cbad452f-cf20-41c8-9a03-b546d1c2eada tempest-VolumesSnapshotNegativeTestJSON-840724784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e508fdd0-01f6-4754-b1a9-af4849913dc9.info" returned: 0 in 0.606s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:14 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-cbad452f-cf20-41c8-9a03-b546d1c2eada tempest-VolumesSnapshotNegativeTestJSON-840724784 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e508fdd0-01f6-4754-b1a9-af4849913dc9.info is being set with open permissions: ugo+rw Apr 24 13:54:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-cbad452f-cf20-41c8-9a03-b546d1c2eada tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e508fdd0-01f6-4754-b1a9-af4849913dc9.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:14 devstack sudo[89187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e508fdd0-01f6-4754-b1a9-af4849913dc9.info Apr 24 13:54:14 devstack sudo[89187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:14 devstack sudo[89187]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-cbad452f-cf20-41c8-9a03-b546d1c2eada tempest-VolumesSnapshotNegativeTestJSON-840724784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e508fdd0-01f6-4754-b1a9-af4849913dc9.info" returned: 0 in 0.553s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-cbad452f-cf20-41c8-9a03-b546d1c2eada tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.133s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:54:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.442s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:54:14 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:54:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2110536533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91555f81-717b-43a9-88de-cd288fb63401,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecb99be5e8b7442b861e395c1120837d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:54:10Z,use_quota=True,user_id='523fde7f25bb48cb8d4d69d1b415e4dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:54:14 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] Creating volume 91555f81-717b-43a9-88de-cd288fb63401 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:54:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:54:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:54:14 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:54:15 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:54:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:54:15 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:54:15 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:54:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-91555f81-717b-43a9-88de-cd288fb63401 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:15 devstack sudo[89190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-91555f81-717b-43a9-88de-cd288fb63401 1073741824 Apr 24 13:54:15 devstack sudo[89190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:15 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-cbad452f-cf20-41c8-9a03-b546d1c2eada tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Create snapshot completed successfully Apr 24 13:54:15 devstack sudo[89190]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-91555f81-717b-43a9-88de-cd288fb63401 1073741824" returned: 0 in 0.735s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-91555f81-717b-43a9-88de-cd288fb63401 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:15 devstack sudo[89196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-91555f81-717b-43a9-88de-cd288fb63401 Apr 24 13:54:15 devstack sudo[89196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:16 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d9329cf9-b7fe-4377-8ea1-b15a8e0a8065 tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Acquiring lock "cinder-aa4d81ce-ac1e-4520-aef8-7368b57a463f-delete_snapshot" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:54:16 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d9329cf9-b7fe-4377-8ea1-b15a8e0a8065 tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Lock "cinder-aa4d81ce-ac1e-4520-aef8-7368b57a463f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:54:16 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d9329cf9-b7fe-4377-8ea1-b15a8e0a8065 tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Acquiring lock "cinder-quobyte-e508fdd0-01f6-4754-b1a9-af4849913dc9" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:54:16 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d9329cf9-b7fe-4377-8ea1-b15a8e0a8065 tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Lock "cinder-quobyte-e508fdd0-01f6-4754-b1a9-af4849913dc9" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:54:16 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d9329cf9-b7fe-4377-8ea1-b15a8e0a8065 tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Acquiring lock "cinder-quobyte-aa4d81ce-ac1e-4520-aef8-7368b57a463f" by "_delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:54:16 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d9329cf9-b7fe-4377-8ea1-b15a8e0a8065 tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Lock "cinder-quobyte-aa4d81ce-ac1e-4520-aef8-7368b57a463f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:54:16 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-d9329cf9-b7fe-4377-8ea1-b15a8e0a8065 tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Deleting offline snapshot aa4d81ce-ac1e-4520-aef8-7368b57a463f of volume e508fdd0-01f6-4754-b1a9-af4849913dc9 {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 13:54:16 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-d9329cf9-b7fe-4377-8ea1-b15a8e0a8065 tempest-VolumesSnapshotNegativeTestJSON-840724784 None] snapshot_file for this snap is: volume-e508fdd0-01f6-4754-b1a9-af4849913dc9.aa4d81ce-ac1e-4520-aef8-7368b57a463f {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 13:54:16 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[99339a4a-d3c6-409f-bbf2-3ecaf6fe8562]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:54:16 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d9329cf9-b7fe-4377-8ea1-b15a8e0a8065 tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e508fdd0-01f6-4754-b1a9-af4849913dc9.aa4d81ce-ac1e-4520-aef8-7368b57a463f {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:16 devstack sudo[89198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e508fdd0-01f6-4754-b1a9-af4849913dc9.aa4d81ce-ac1e-4520-aef8-7368b57a463f Apr 24 13:54:16 devstack sudo[89198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:16 devstack sudo[89196]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:16 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-91555f81-717b-43a9-88de-cd288fb63401" returned: 0 in 0.667s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:16 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] <== create_volume: return (1459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:54:16 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:54:16 devstack cinder-volume[82046]: DEBUG cinder.volume.volume_utils [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] Attempting download of 02b8aec0-dc1c-4b93-81c4-ab6b88d472d9 ((None, [{'url': 'file:///opt/stack/data/glance/images/02b8aec0-dc1c-4b93-81c4-ab6b88d472d9', 'metadata': {}}])) to volume 91555f81-717b-43a9-88de-cd288fb63401. {{(pid=82046) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 24 13:54:16 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74773a9-3555-46cb-a598-6a054ce42224]: (4, 'raw') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:54:16 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_bzl7y4g7 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:16 devstack sudo[89201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_bzl7y4g7 Apr 24 13:54:16 devstack sudo[89201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:16 devstack sudo[89198]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:16 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d9329cf9-b7fe-4377-8ea1-b15a8e0a8065 tempest-VolumesSnapshotNegativeTestJSON-840724784 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e508fdd0-01f6-4754-b1a9-af4849913dc9.aa4d81ce-ac1e-4520-aef8-7368b57a463f" returned: 0 in 0.722s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:16 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-d9329cf9-b7fe-4377-8ea1-b15a8e0a8065 tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e508fdd0-01f6-4754-b1a9-af4849913dc9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:54:16 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[44802018-2c82-4b00-84b3-5f7bf30c3981]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:54:16 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d9329cf9-b7fe-4377-8ea1-b15a8e0a8065 tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e508fdd0-01f6-4754-b1a9-af4849913dc9 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:17 devstack sudo[89206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e508fdd0-01f6-4754-b1a9-af4849913dc9 Apr 24 13:54:17 devstack sudo[89206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:17 devstack sudo[89201]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_bzl7y4g7" returned: 0 in 0.583s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_bzl7y4g7 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:17 devstack sudo[89210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_bzl7y4g7 Apr 24 13:54:17 devstack sudo[89210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:17 devstack sudo[89206]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d9329cf9-b7fe-4377-8ea1-b15a8e0a8065 tempest-VolumesSnapshotNegativeTestJSON-840724784 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e508fdd0-01f6-4754-b1a9-af4849913dc9" returned: 0 in 0.796s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d9329cf9-b7fe-4377-8ea1-b15a8e0a8065 tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e508fdd0-01f6-4754-b1a9-af4849913dc9.aa4d81ce-ac1e-4520-aef8-7368b57a463f {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:17 devstack sudo[89251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e508fdd0-01f6-4754-b1a9-af4849913dc9.aa4d81ce-ac1e-4520-aef8-7368b57a463f Apr 24 13:54:17 devstack sudo[89251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:17 devstack sudo[89210]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_bzl7y4g7" returned: 1 in 0.698s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_bzl7y4g7' failed. Not Retrying. {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 13:54:17 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a63920-282b-4f14-bdfe-0a1daa343515]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:54:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_qd43acdndevstack@QuobyteHD {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:17 devstack sudo[89253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_qd43acdndevstack@QuobyteHD Apr 24 13:54:17 devstack sudo[89253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:18 devstack sudo[89251]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:18 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d9329cf9-b7fe-4377-8ea1-b15a8e0a8065 tempest-VolumesSnapshotNegativeTestJSON-840724784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e508fdd0-01f6-4754-b1a9-af4849913dc9.aa4d81ce-ac1e-4520-aef8-7368b57a463f" returned: 0 in 0.675s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:18 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d9329cf9-b7fe-4377-8ea1-b15a8e0a8065 tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e508fdd0-01f6-4754-b1a9-af4849913dc9.aa4d81ce-ac1e-4520-aef8-7368b57a463f {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:18 devstack sudo[89261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e508fdd0-01f6-4754-b1a9-af4849913dc9.aa4d81ce-ac1e-4520-aef8-7368b57a463f Apr 24 13:54:18 devstack sudo[89261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:18 devstack sudo[89253]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:18 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_qd43acdndevstack@QuobyteHD" returned: 0 in 0.633s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:18 devstack cinder-volume[82046]: DEBUG cinder.image.image_utils [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] 02b8aec0-dc1c-4b93-81c4-ab6b88d472d9 was qcow2, converting to raw {{(pid=82046) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 24 13:54:18 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_qd43acdndevstack@QuobyteHD /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-91555f81-717b-43a9-88de-cd288fb63401 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:18 devstack sudo[89263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_qd43acdndevstack@QuobyteHD /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-91555f81-717b-43a9-88de-cd288fb63401 Apr 24 13:54:18 devstack sudo[89263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:18 devstack sudo[89261]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:18 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d9329cf9-b7fe-4377-8ea1-b15a8e0a8065 tempest-VolumesSnapshotNegativeTestJSON-840724784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e508fdd0-01f6-4754-b1a9-af4849913dc9.aa4d81ce-ac1e-4520-aef8-7368b57a463f" returned: 0 in 0.513s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:19 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d9329cf9-b7fe-4377-8ea1-b15a8e0a8065 tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Lock "cinder-quobyte-aa4d81ce-ac1e-4520-aef8-7368b57a463f" released by "_delete_snapshot" :: held 2.843s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:54:19 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d9329cf9-b7fe-4377-8ea1-b15a8e0a8065 tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Lock "cinder-quobyte-e508fdd0-01f6-4754-b1a9-af4849913dc9" released by "delete_snapshot" :: held 2.872s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:54:19 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-d9329cf9-b7fe-4377-8ea1-b15a8e0a8065 tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Created reservations ['394324f4-5e7f-4b12-a328-037183e658f4', 'c9cf8f77-3050-4202-b6ba-1c9a758422b0', '3e917fa7-8d69-4138-9018-4527211832e2', '7a04e719-ea65-472b-874c-0d4a142b249e'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:54:19 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-d9329cf9-b7fe-4377-8ea1-b15a8e0a8065 tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Delete snapshot completed successfully. Apr 24 13:54:19 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d9329cf9-b7fe-4377-8ea1-b15a8e0a8065 tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Lock "cinder-aa4d81ce-ac1e-4520-aef8-7368b57a463f-delete_snapshot" released by "delete_snapshot" :: held 3.072s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:54:19 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-3d01b26f-5069-4207-b832-80f949f28cdb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Acquiring lock "cinder-e508fdd0-01f6-4754-b1a9-af4849913dc9-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:54:19 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-3d01b26f-5069-4207-b832-80f949f28cdb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Lock "cinder-e508fdd0-01f6-4754-b1a9-af4849913dc9-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:54:19 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-3d01b26f-5069-4207-b832-80f949f28cdb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Acquiring lock "cinder-quobyte-e508fdd0-01f6-4754-b1a9-af4849913dc9" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:54:19 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-3d01b26f-5069-4207-b832-80f949f28cdb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Lock "cinder-quobyte-e508fdd0-01f6-4754-b1a9-af4849913dc9" acquired by "delete_volume" :: waited 0.024s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:54:19 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[86be3ab2-d226-42ce-8949-353e79186573]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:54:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3d01b26f-5069-4207-b832-80f949f28cdb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e508fdd0-01f6-4754-b1a9-af4849913dc9 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:19 devstack sudo[89277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e508fdd0-01f6-4754-b1a9-af4849913dc9 Apr 24 13:54:19 devstack sudo[89277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:20 devstack sudo[89263]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:20 devstack sudo[89277]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3d01b26f-5069-4207-b832-80f949f28cdb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e508fdd0-01f6-4754-b1a9-af4849913dc9" returned: 0 in 0.709s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3d01b26f-5069-4207-b832-80f949f28cdb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e508fdd0-01f6-4754-b1a9-af4849913dc9 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_qd43acdndevstack@QuobyteHD /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-91555f81-717b-43a9-88de-cd288fb63401" returned: 0 in 1.844s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:20 devstack cinder-volume[82046]: DEBUG cinder.image.image_utils [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_qd43acdndevstack@QuobyteHD, size 112.00 MB, duration 1.85 sec, destination /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-91555f81-717b-43a9-88de-cd288fb63401 {{(pid=82046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 13:54:20 devstack cinder-volume[82046]: INFO cinder.image.image_utils [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] Converted 112.00 MB image at 60.64 MB/s Apr 24 13:54:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-91555f81-717b-43a9-88de-cd288fb63401 1G {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:20 devstack sudo[89282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e508fdd0-01f6-4754-b1a9-af4849913dc9 Apr 24 13:54:20 devstack sudo[89282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:20 devstack sudo[89283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-91555f81-717b-43a9-88de-cd288fb63401 1G Apr 24 13:54:20 devstack sudo[89283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:20 devstack sudo[89282]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3d01b26f-5069-4207-b832-80f949f28cdb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e508fdd0-01f6-4754-b1a9-af4849913dc9" returned: 0 in 0.553s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:20 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-3d01b26f-5069-4207-b832-80f949f28cdb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Lock "cinder-quobyte-e508fdd0-01f6-4754-b1a9-af4849913dc9" released by "delete_volume" :: held 1.355s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:54:20 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-3d01b26f-5069-4207-b832-80f949f28cdb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Created reservations ['1470c969-35d8-4a5a-84b5-1df41ab2d6fa', '3c8b91aa-05fd-4d97-ba7f-bd0a5bce8226', '022f9e3d-d915-44e9-8d7f-1918721d6b59', '605abfbb-0eae-490c-8b9d-f0447e850c8d'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:54:21 devstack sudo[89283]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-91555f81-717b-43a9-88de-cd288fb63401 1G" returned: 0 in 0.750s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-3d01b26f-5069-4207-b832-80f949f28cdb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:54:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-3d01b26f-5069-4207-b832-80f949f28cdb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:54:21 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-3d01b26f-5069-4207-b832-80f949f28cdb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:54:21 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-3d01b26f-5069-4207-b832-80f949f28cdb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:54:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-3d01b26f-5069-4207-b832-80f949f28cdb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:54:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3d01b26f-5069-4207-b832-80f949f28cdb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:21 devstack sudo[89290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:54:21 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ef697b-7ddc-4d73-a585-c75799394cf2]: (4, 'raw') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:54:21 devstack sudo[89290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-91555f81-717b-43a9-88de-cd288fb63401 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:21 devstack sudo[89292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-91555f81-717b-43a9-88de-cd288fb63401 Apr 24 13:54:21 devstack sudo[89292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:21 devstack sudo[89290]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3d01b26f-5069-4207-b832-80f949f28cdb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.566s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:21 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-3d01b26f-5069-4207-b832-80f949f28cdb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:54:21 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-3d01b26f-5069-4207-b832-80f949f28cdb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Deleted volume successfully. Apr 24 13:54:21 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-3d01b26f-5069-4207-b832-80f949f28cdb tempest-VolumesSnapshotNegativeTestJSON-840724784 None] Lock "cinder-e508fdd0-01f6-4754-b1a9-af4849913dc9-delete_volume" released by "delete_volume" :: held 2.249s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:54:21 devstack sudo[89292]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-91555f81-717b-43a9-88de-cd288fb63401" returned: 0 in 0.708s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-91555f81-717b-43a9-88de-cd288fb63401 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:21 devstack sudo[89297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-91555f81-717b-43a9-88de-cd288fb63401 Apr 24 13:54:21 devstack sudo[89297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:22 devstack sudo[89297]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-91555f81-717b-43a9-88de-cd288fb63401" returned: 1 in 0.666s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-91555f81-717b-43a9-88de-cd288fb63401' failed. Not Retrying. {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 13:54:22 devstack cinder-volume[82046]: DEBUG cinder.volume.volume_utils [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] Downloaded image 02b8aec0-dc1c-4b93-81c4-ab6b88d472d9 ((None, [{'url': 'file:///opt/stack/data/glance/images/02b8aec0-dc1c-4b93-81c4-ab6b88d472d9', 'metadata': {}}])) to volume 91555f81-717b-43a9-88de-cd288fb63401 successfully. {{(pid=82046) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 24 13:54:22 devstack cinder-volume[82046]: DEBUG cinder.image.image_utils [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] Temporary image 02b8aec0-dc1c-4b93-81c4-ab6b88d472d9 for user 523fde7f25bb48cb8d4d69d1b415e4dc is deleted. {{(pid=82046) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 24 13:54:22 devstack cinder-volume[82046]: DEBUG cinder.volume.volume_utils [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] Marking volume 91555f81-717b-43a9-88de-cd288fb63401 as bootable. {{(pid=82046) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 24 13:54:22 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] Copying metadata from image 02b8aec0-dc1c-4b93-81c4-ab6b88d472d9 to 91555f81-717b-43a9-88de-cd288fb63401. {{(pid=82046) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 24 13:54:22 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] Creating volume glance metadata for volume 91555f81-717b-43a9-88de-cd288fb63401 backed by image 02b8aec0-dc1c-4b93-81c4-ab6b88d472d9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '02b8aec0-dc1c-4b93-81c4-ab6b88d472d9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82046) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 24 13:54:22 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9461104b-cb16-46d8-971e-d1cdb9588524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91555f81-717b-43a9-88de-cd288fb63401', 'volume_size': 1, 'image_id': '02b8aec0-dc1c-4b93-81c4-ab6b88d472d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02b8aec0-dc1c-4b93-81c4-ab6b88d472d9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db6d5b1c41254596bd8bad1e5f7bec28', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02b8aec0-dc1c-4b93-81c4-ab6b88d472d9', 'created_at': datetime.datetime(2026, 4, 24, 11, 39, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 11, 39, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02b8aec0-dc1c-4b93-81c4-ab6b88d472d9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:22 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (265a663b-3ee8-482e-a3a5-b010a0985d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:22 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] Volume volume-91555f81-717b-43a9-88de-cd288fb63401 (91555f81-717b-43a9-88de-cd288fb63401): created successfully Apr 24 13:54:22 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (265a663b-3ee8-482e-a3a5-b010a0985d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:22 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] Flow 'volume_create_manager' (c5506268-2bc1-4290-96a4-72d3f83c6e70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:54:22 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-45abdd35-307e-4abe-a9bd-9b73dda6f67f tempest-VolumesImageMetadata-157430663 None] Created volume successfully. Apr 24 13:54:23 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-25663f8c-8d56-4323-a1d5-3090956dd887 tempest-VolumesImageMetadata-157430663 None] Acquiring lock "cinder-91555f81-717b-43a9-88de-cd288fb63401-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:54:23 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-25663f8c-8d56-4323-a1d5-3090956dd887 tempest-VolumesImageMetadata-157430663 None] Lock "cinder-91555f81-717b-43a9-88de-cd288fb63401-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:54:23 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-25663f8c-8d56-4323-a1d5-3090956dd887 tempest-VolumesImageMetadata-157430663 None] Acquiring lock "cinder-quobyte-91555f81-717b-43a9-88de-cd288fb63401" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:54:23 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-25663f8c-8d56-4323-a1d5-3090956dd887 tempest-VolumesImageMetadata-157430663 None] Lock "cinder-quobyte-91555f81-717b-43a9-88de-cd288fb63401" acquired by "delete_volume" :: waited 0.019s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:54:23 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35b7760-a74a-4fa1-a255-4f996d12739a]: (4, 'raw') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:54:23 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-25663f8c-8d56-4323-a1d5-3090956dd887 tempest-VolumesImageMetadata-157430663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-91555f81-717b-43a9-88de-cd288fb63401 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:23 devstack sudo[89302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-91555f81-717b-43a9-88de-cd288fb63401 Apr 24 13:54:23 devstack sudo[89302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:24 devstack sudo[89302]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-25663f8c-8d56-4323-a1d5-3090956dd887 tempest-VolumesImageMetadata-157430663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-91555f81-717b-43a9-88de-cd288fb63401" returned: 0 in 0.668s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-25663f8c-8d56-4323-a1d5-3090956dd887 tempest-VolumesImageMetadata-157430663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-91555f81-717b-43a9-88de-cd288fb63401 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:24 devstack sudo[89306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-91555f81-717b-43a9-88de-cd288fb63401 Apr 24 13:54:24 devstack sudo[89306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:25 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e12a810-ccfb-4132-85ab-138873989a89 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:54:25 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4e12a810-ccfb-4132-85ab-138873989a89 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Flow 'volume_create_manager' (b6eec39f-e1ff-4044-bd7c-d50f02d60450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:54:25 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4e12a810-ccfb-4132-85ab-138873989a89 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b8bf426-4fe9-495a-9bf0-9987f506d66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:25 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4e12a810-ccfb-4132-85ab-138873989a89 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b8bf426-4fe9-495a-9bf0-9987f506d66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-550443375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44bec76e-5f00-4998-af0d-847657adf581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e338464d41754fa99e7d495b73f16331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:54:25Z,use_quota=True,user_id='970cb501f658426c8981ba3bc6c859f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:25 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4e12a810-ccfb-4132-85ab-138873989a89 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7080302-6e0c-4812-b8cc-2d9a216b66d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:25 devstack sudo[89306]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:25 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4e12a810-ccfb-4132-85ab-138873989a89 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7080302-6e0c-4812-b8cc-2d9a216b66d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:25 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4e12a810-ccfb-4132-85ab-138873989a89 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0db2660f-a0ee-4216-9bfb-88e1895cbc19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:25 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4e12a810-ccfb-4132-85ab-138873989a89 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0db2660f-a0ee-4216-9bfb-88e1895cbc19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44bec76e-5f00-4998-af0d-847657adf581', 'volume_name': 'volume-44bec76e-5f00-4998-af0d-847657adf581', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:25 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4e12a810-ccfb-4132-85ab-138873989a89 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c572fed-f38e-4811-981b-4340bb536653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:25 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4e12a810-ccfb-4132-85ab-138873989a89 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c572fed-f38e-4811-981b-4340bb536653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:25 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4e12a810-ccfb-4132-85ab-138873989a89 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3075cba4-c36d-4c82-8733-9fed5daf6b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:25 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-4e12a810-ccfb-4132-85ab-138873989a89 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Volume 44bec76e-5f00-4998-af0d-847657adf581: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44bec76e-5f00-4998-af0d-847657adf581', 'volume_size': 1} Apr 24 13:54:25 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4e12a810-ccfb-4132-85ab-138873989a89 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:54:25 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4e12a810-ccfb-4132-85ab-138873989a89 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:54:25 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-4e12a810-ccfb-4132-85ab-138873989a89 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-550443375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44bec76e-5f00-4998-af0d-847657adf581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e338464d41754fa99e7d495b73f16331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:54:25Z,use_quota=True,user_id='970cb501f658426c8981ba3bc6c859f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:54:25 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-4e12a810-ccfb-4132-85ab-138873989a89 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Creating volume 44bec76e-5f00-4998-af0d-847657adf581 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:54:25 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4e12a810-ccfb-4132-85ab-138873989a89 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:54:25 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4e12a810-ccfb-4132-85ab-138873989a89 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:54:25 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-4e12a810-ccfb-4132-85ab-138873989a89 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:54:25 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-4e12a810-ccfb-4132-85ab-138873989a89 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:54:25 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4e12a810-ccfb-4132-85ab-138873989a89 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:54:25 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-4e12a810-ccfb-4132-85ab-138873989a89 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:54:25 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-4e12a810-ccfb-4132-85ab-138873989a89 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:54:25 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4e12a810-ccfb-4132-85ab-138873989a89 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44bec76e-5f00-4998-af0d-847657adf581 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:25 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-25663f8c-8d56-4323-a1d5-3090956dd887 tempest-VolumesImageMetadata-157430663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-91555f81-717b-43a9-88de-cd288fb63401" returned: 1 in 0.773s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:25 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-25663f8c-8d56-4323-a1d5-3090956dd887 tempest-VolumesImageMetadata-157430663 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-91555f81-717b-43a9-88de-cd288fb63401' failed. Not Retrying. {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 13:54:25 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-25663f8c-8d56-4323-a1d5-3090956dd887 tempest-VolumesImageMetadata-157430663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-91555f81-717b-43a9-88de-cd288fb63401 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:25 devstack sudo[89311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44bec76e-5f00-4998-af0d-847657adf581 1073741824 Apr 24 13:54:25 devstack sudo[89311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:25 devstack sudo[89312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-91555f81-717b-43a9-88de-cd288fb63401 Apr 24 13:54:25 devstack sudo[89312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:26 devstack sudo[89312]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-25663f8c-8d56-4323-a1d5-3090956dd887 tempest-VolumesImageMetadata-157430663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-91555f81-717b-43a9-88de-cd288fb63401" returned: 0 in 0.766s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:26 devstack sudo[89311]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:26 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-25663f8c-8d56-4323-a1d5-3090956dd887 tempest-VolumesImageMetadata-157430663 None] Lock "cinder-quobyte-91555f81-717b-43a9-88de-cd288fb63401" released by "delete_volume" :: held 2.290s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:54:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4e12a810-ccfb-4132-85ab-138873989a89 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44bec76e-5f00-4998-af0d-847657adf581 1073741824" returned: 0 in 0.818s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4e12a810-ccfb-4132-85ab-138873989a89 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44bec76e-5f00-4998-af0d-847657adf581 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:26 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-25663f8c-8d56-4323-a1d5-3090956dd887 tempest-VolumesImageMetadata-157430663 None] Created reservations ['2110470b-0df9-4cfc-95f3-9116b29a52e5', '095bfce1-078f-4ecb-9a2e-5b63f8fc5d70', 'f54e4b1f-c9ff-4e23-9fe9-00bb4c3d56d9', '497aa473-4774-477c-ad24-b46d89954bbd'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:54:26 devstack sudo[89320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44bec76e-5f00-4998-af0d-847657adf581 Apr 24 13:54:26 devstack sudo[89320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-25663f8c-8d56-4323-a1d5-3090956dd887 tempest-VolumesImageMetadata-157430663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:54:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-25663f8c-8d56-4323-a1d5-3090956dd887 tempest-VolumesImageMetadata-157430663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:54:26 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-25663f8c-8d56-4323-a1d5-3090956dd887 tempest-VolumesImageMetadata-157430663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:54:26 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-25663f8c-8d56-4323-a1d5-3090956dd887 tempest-VolumesImageMetadata-157430663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:54:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-25663f8c-8d56-4323-a1d5-3090956dd887 tempest-VolumesImageMetadata-157430663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:54:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-25663f8c-8d56-4323-a1d5-3090956dd887 tempest-VolumesImageMetadata-157430663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:26 devstack sudo[89322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:54:26 devstack sudo[89322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:26 devstack sudo[89320]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4e12a810-ccfb-4132-85ab-138873989a89 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44bec76e-5f00-4998-af0d-847657adf581" returned: 0 in 0.707s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:26 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-4e12a810-ccfb-4132-85ab-138873989a89 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:54:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4e12a810-ccfb-4132-85ab-138873989a89 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.579s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:54:26 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4e12a810-ccfb-4132-85ab-138873989a89 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3075cba4-c36d-4c82-8733-9fed5daf6b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44bec76e-5f00-4998-af0d-847657adf581', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:26 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4e12a810-ccfb-4132-85ab-138873989a89 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df96dbb7-ab1e-4fcc-8a65-c3854270fa86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:26 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-4e12a810-ccfb-4132-85ab-138873989a89 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Volume volume-44bec76e-5f00-4998-af0d-847657adf581 (44bec76e-5f00-4998-af0d-847657adf581): created successfully Apr 24 13:54:26 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4e12a810-ccfb-4132-85ab-138873989a89 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df96dbb7-ab1e-4fcc-8a65-c3854270fa86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:26 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4e12a810-ccfb-4132-85ab-138873989a89 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Flow 'volume_create_manager' (b6eec39f-e1ff-4044-bd7c-d50f02d60450) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:54:26 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-4e12a810-ccfb-4132-85ab-138873989a89 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Created volume successfully. Apr 24 13:54:26 devstack sudo[89322]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-25663f8c-8d56-4323-a1d5-3090956dd887 tempest-VolumesImageMetadata-157430663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.664s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:26 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-25663f8c-8d56-4323-a1d5-3090956dd887 tempest-VolumesImageMetadata-157430663 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:54:26 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-25663f8c-8d56-4323-a1d5-3090956dd887 tempest-VolumesImageMetadata-157430663 None] Deleted volume successfully. Apr 24 13:54:27 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-25663f8c-8d56-4323-a1d5-3090956dd887 tempest-VolumesImageMetadata-157430663 None] Lock "cinder-91555f81-717b-43a9-88de-cd288fb63401-delete_volume" released by "delete_volume" :: held 3.277s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:54:27 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fd9b0c9-5362-4158-a57d-a5b7a35a7588 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:54:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-7fd9b0c9-5362-4158-a57d-a5b7a35a7588 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Flow 'volume_create_manager' (48be2302-b8e8-43c3-94d9-ad00cc84483b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:54:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-7fd9b0c9-5362-4158-a57d-a5b7a35a7588 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac38e1cc-3ddd-40da-91b1-83fdaaca96c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-7fd9b0c9-5362-4158-a57d-a5b7a35a7588 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac38e1cc-3ddd-40da-91b1-83fdaaca96c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-797097853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69dc6907-843d-467f-bfed-9992a03f3187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e338464d41754fa99e7d495b73f16331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:54:28Z,use_quota=True,user_id='970cb501f658426c8981ba3bc6c859f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-7fd9b0c9-5362-4158-a57d-a5b7a35a7588 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f225074b-62d9-4124-a60a-49f45743c766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-7fd9b0c9-5362-4158-a57d-a5b7a35a7588 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f225074b-62d9-4124-a60a-49f45743c766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-7fd9b0c9-5362-4158-a57d-a5b7a35a7588 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aea56b3b-59b3-4a5d-83ec-ea1a6f0dffa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-7fd9b0c9-5362-4158-a57d-a5b7a35a7588 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aea56b3b-59b3-4a5d-83ec-ea1a6f0dffa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69dc6907-843d-467f-bfed-9992a03f3187', 'volume_name': 'volume-69dc6907-843d-467f-bfed-9992a03f3187', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-7fd9b0c9-5362-4158-a57d-a5b7a35a7588 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc808a0b-b65d-459d-84dd-7f972f0f6c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-7fd9b0c9-5362-4158-a57d-a5b7a35a7588 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc808a0b-b65d-459d-84dd-7f972f0f6c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-7fd9b0c9-5362-4158-a57d-a5b7a35a7588 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb8f829a-bb7d-489d-ad57-ddebdcd7b7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:28 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-7fd9b0c9-5362-4158-a57d-a5b7a35a7588 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Volume 69dc6907-843d-467f-bfed-9992a03f3187: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69dc6907-843d-467f-bfed-9992a03f3187', 'volume_size': 1} Apr 24 13:54:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-7fd9b0c9-5362-4158-a57d-a5b7a35a7588 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:54:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-7fd9b0c9-5362-4158-a57d-a5b7a35a7588 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:54:28 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-7fd9b0c9-5362-4158-a57d-a5b7a35a7588 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-797097853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69dc6907-843d-467f-bfed-9992a03f3187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e338464d41754fa99e7d495b73f16331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:54:28Z,use_quota=True,user_id='970cb501f658426c8981ba3bc6c859f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:54:28 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-7fd9b0c9-5362-4158-a57d-a5b7a35a7588 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Creating volume 69dc6907-843d-467f-bfed-9992a03f3187 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:54:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-7fd9b0c9-5362-4158-a57d-a5b7a35a7588 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:54:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-7fd9b0c9-5362-4158-a57d-a5b7a35a7588 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:54:28 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-7fd9b0c9-5362-4158-a57d-a5b7a35a7588 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:54:28 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-7fd9b0c9-5362-4158-a57d-a5b7a35a7588 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:54:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-7fd9b0c9-5362-4158-a57d-a5b7a35a7588 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:54:28 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-7fd9b0c9-5362-4158-a57d-a5b7a35a7588 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:54:28 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-7fd9b0c9-5362-4158-a57d-a5b7a35a7588 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:54:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7fd9b0c9-5362-4158-a57d-a5b7a35a7588 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-69dc6907-843d-467f-bfed-9992a03f3187 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:28 devstack sudo[89326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-69dc6907-843d-467f-bfed-9992a03f3187 1073741824 Apr 24 13:54:28 devstack sudo[89326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:28 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8b5b28a-5718-4299-98ad-644f88b1d40b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:54:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a8b5b28a-5718-4299-98ad-644f88b1d40b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Flow 'volume_create_manager' (52db004e-fa0e-4d0d-b737-9e2fe61249ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:54:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a8b5b28a-5718-4299-98ad-644f88b1d40b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5db751d-8667-4871-87e2-4f2dbc7688ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a8b5b28a-5718-4299-98ad-644f88b1d40b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5db751d-8667-4871-87e2-4f2dbc7688ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-395775340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cebcf94-26f6-44b5-bb08-2b6155bf405a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e338464d41754fa99e7d495b73f16331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:54:28Z,use_quota=True,user_id='970cb501f658426c8981ba3bc6c859f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a8b5b28a-5718-4299-98ad-644f88b1d40b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e2c4554-1738-463e-88e1-fb61b804f4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a8b5b28a-5718-4299-98ad-644f88b1d40b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e2c4554-1738-463e-88e1-fb61b804f4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a8b5b28a-5718-4299-98ad-644f88b1d40b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8405df5-5bc0-4a81-ab1c-140d27f513ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a8b5b28a-5718-4299-98ad-644f88b1d40b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8405df5-5bc0-4a81-ab1c-140d27f513ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cebcf94-26f6-44b5-bb08-2b6155bf405a', 'volume_name': 'volume-3cebcf94-26f6-44b5-bb08-2b6155bf405a', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a8b5b28a-5718-4299-98ad-644f88b1d40b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (622f2914-e2d6-4e3b-a987-87d2d8ee8847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a8b5b28a-5718-4299-98ad-644f88b1d40b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (622f2914-e2d6-4e3b-a987-87d2d8ee8847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a8b5b28a-5718-4299-98ad-644f88b1d40b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30e908dc-9224-4180-808f-6503f2d1b228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:28 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-a8b5b28a-5718-4299-98ad-644f88b1d40b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Volume 3cebcf94-26f6-44b5-bb08-2b6155bf405a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cebcf94-26f6-44b5-bb08-2b6155bf405a', 'volume_size': 1} Apr 24 13:54:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a8b5b28a-5718-4299-98ad-644f88b1d40b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:54:28 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a75c4ef-c9cf-4ec0-8165-567a3b855cb2 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:54:29 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5a75c4ef-c9cf-4ec0-8165-567a3b855cb2 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Flow 'volume_create_manager' (e390098b-5b0d-4a49-9914-defae97bc073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:54:29 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5a75c4ef-c9cf-4ec0-8165-567a3b855cb2 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49596809-2838-4d9c-bd18-805f84828c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:29 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5a75c4ef-c9cf-4ec0-8165-567a3b855cb2 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49596809-2838-4d9c-bd18-805f84828c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1056139279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f4f8012-f642-483c-9d46-df489fbd673c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e338464d41754fa99e7d495b73f16331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:54:29Z,use_quota=True,user_id='970cb501f658426c8981ba3bc6c859f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:29 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5a75c4ef-c9cf-4ec0-8165-567a3b855cb2 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68cc7030-ab07-465a-9be4-e0bddfa9b54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:29 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5a75c4ef-c9cf-4ec0-8165-567a3b855cb2 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68cc7030-ab07-465a-9be4-e0bddfa9b54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:29 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5a75c4ef-c9cf-4ec0-8165-567a3b855cb2 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3fc640d-a1d8-4efc-b1a3-9533569ea494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:29 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5a75c4ef-c9cf-4ec0-8165-567a3b855cb2 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3fc640d-a1d8-4efc-b1a3-9533569ea494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f4f8012-f642-483c-9d46-df489fbd673c', 'volume_name': 'volume-1f4f8012-f642-483c-9d46-df489fbd673c', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:29 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5a75c4ef-c9cf-4ec0-8165-567a3b855cb2 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (831844c8-70e7-4419-b27e-cf8285b198fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:29 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5a75c4ef-c9cf-4ec0-8165-567a3b855cb2 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (831844c8-70e7-4419-b27e-cf8285b198fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:29 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5a75c4ef-c9cf-4ec0-8165-567a3b855cb2 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfac530b-36ef-499c-832c-8bd69aa31a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:29 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-5a75c4ef-c9cf-4ec0-8165-567a3b855cb2 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Volume 1f4f8012-f642-483c-9d46-df489fbd673c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f4f8012-f642-483c-9d46-df489fbd673c', 'volume_size': 1} Apr 24 13:54:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5a75c4ef-c9cf-4ec0-8165-567a3b855cb2 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:54:29 devstack sudo[89326]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7fd9b0c9-5362-4158-a57d-a5b7a35a7588 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-69dc6907-843d-467f-bfed-9992a03f3187 1073741824" returned: 0 in 1.068s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7fd9b0c9-5362-4158-a57d-a5b7a35a7588 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-69dc6907-843d-467f-bfed-9992a03f3187 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:29 devstack sudo[89331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-69dc6907-843d-467f-bfed-9992a03f3187 Apr 24 13:54:29 devstack sudo[89331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:29 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-856f4d1d-8e16-4fed-b445-73cde393726d tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:54:29 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-856f4d1d-8e16-4fed-b445-73cde393726d tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Flow 'volume_create_manager' (ee5b2ce6-2f67-4cc4-8729-8c412a197c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:54:29 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-856f4d1d-8e16-4fed-b445-73cde393726d tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67366b71-51b7-4ed0-994c-08c6cb15722e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:29 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-856f4d1d-8e16-4fed-b445-73cde393726d tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67366b71-51b7-4ed0-994c-08c6cb15722e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2044741727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f3ed6f9-41ce-44da-9df0-48cb45b0b466,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e338464d41754fa99e7d495b73f16331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:54:29Z,use_quota=True,user_id='970cb501f658426c8981ba3bc6c859f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:29 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-856f4d1d-8e16-4fed-b445-73cde393726d tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5385167c-a89e-497b-97a0-e9cf140321f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:29 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-856f4d1d-8e16-4fed-b445-73cde393726d tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5385167c-a89e-497b-97a0-e9cf140321f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:29 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-856f4d1d-8e16-4fed-b445-73cde393726d tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e908d136-cd9c-4ac8-8b43-b8e9bd2e08d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:29 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-856f4d1d-8e16-4fed-b445-73cde393726d tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e908d136-cd9c-4ac8-8b43-b8e9bd2e08d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f3ed6f9-41ce-44da-9df0-48cb45b0b466', 'volume_name': 'volume-7f3ed6f9-41ce-44da-9df0-48cb45b0b466', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:29 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-856f4d1d-8e16-4fed-b445-73cde393726d tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aaf549a-28fa-41bb-a0cc-5d8e99069977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:29 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-856f4d1d-8e16-4fed-b445-73cde393726d tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aaf549a-28fa-41bb-a0cc-5d8e99069977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:29 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-856f4d1d-8e16-4fed-b445-73cde393726d tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (537b342e-c007-4906-a182-b27c38ffe12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:29 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-856f4d1d-8e16-4fed-b445-73cde393726d tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Volume 7f3ed6f9-41ce-44da-9df0-48cb45b0b466: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f3ed6f9-41ce-44da-9df0-48cb45b0b466', 'volume_size': 1} Apr 24 13:54:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-856f4d1d-8e16-4fed-b445-73cde393726d tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:54:29 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-af151c89-2b9b-425b-8d32-1dc51928dfc9 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:54:29 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-af151c89-2b9b-425b-8d32-1dc51928dfc9 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Flow 'volume_create_manager' (785ab168-c883-4585-a026-fb45fe3494ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:54:29 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-af151c89-2b9b-425b-8d32-1dc51928dfc9 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5c666a9-14dc-4550-81bf-ae1c7eb1f071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:29 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-af151c89-2b9b-425b-8d32-1dc51928dfc9 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5c666a9-14dc-4550-81bf-ae1c7eb1f071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-618900949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3db7c004-c5a3-44a8-8554-6a3d992ff53a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e338464d41754fa99e7d495b73f16331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:54:30Z,use_quota=True,user_id='970cb501f658426c8981ba3bc6c859f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:29 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-af151c89-2b9b-425b-8d32-1dc51928dfc9 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c70b6485-a76e-498b-b69a-201ae0ce08f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:29 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-af151c89-2b9b-425b-8d32-1dc51928dfc9 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c70b6485-a76e-498b-b69a-201ae0ce08f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:29 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-af151c89-2b9b-425b-8d32-1dc51928dfc9 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a76adedb-1627-436d-8a2b-f19a5696514e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:29 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-af151c89-2b9b-425b-8d32-1dc51928dfc9 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a76adedb-1627-436d-8a2b-f19a5696514e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3db7c004-c5a3-44a8-8554-6a3d992ff53a', 'volume_name': 'volume-3db7c004-c5a3-44a8-8554-6a3d992ff53a', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:29 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-af151c89-2b9b-425b-8d32-1dc51928dfc9 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea99a40f-0b5d-4fb6-9885-a82ccb28f97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:29 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-af151c89-2b9b-425b-8d32-1dc51928dfc9 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea99a40f-0b5d-4fb6-9885-a82ccb28f97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:29 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-af151c89-2b9b-425b-8d32-1dc51928dfc9 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8017e9e-e5eb-4730-953c-551b76ece80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:29 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-af151c89-2b9b-425b-8d32-1dc51928dfc9 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Volume 3db7c004-c5a3-44a8-8554-6a3d992ff53a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3db7c004-c5a3-44a8-8554-6a3d992ff53a', 'volume_size': 1} Apr 24 13:54:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-af151c89-2b9b-425b-8d32-1dc51928dfc9 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:54:30 devstack sudo[89331]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7fd9b0c9-5362-4158-a57d-a5b7a35a7588 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-69dc6907-843d-467f-bfed-9992a03f3187" returned: 0 in 0.889s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:30 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-7fd9b0c9-5362-4158-a57d-a5b7a35a7588 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] <== create_volume: return (2010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:54:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-7fd9b0c9-5362-4158-a57d-a5b7a35a7588 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.012s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:54:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a8b5b28a-5718-4299-98ad-644f88b1d40b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.479s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:54:30 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a8b5b28a-5718-4299-98ad-644f88b1d40b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-395775340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cebcf94-26f6-44b5-bb08-2b6155bf405a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e338464d41754fa99e7d495b73f16331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:54:28Z,use_quota=True,user_id='970cb501f658426c8981ba3bc6c859f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:54:30 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-a8b5b28a-5718-4299-98ad-644f88b1d40b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Creating volume 3cebcf94-26f6-44b5-bb08-2b6155bf405a {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:54:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a8b5b28a-5718-4299-98ad-644f88b1d40b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:54:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a8b5b28a-5718-4299-98ad-644f88b1d40b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:54:30 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a8b5b28a-5718-4299-98ad-644f88b1d40b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:54:30 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a8b5b28a-5718-4299-98ad-644f88b1d40b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:54:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a8b5b28a-5718-4299-98ad-644f88b1d40b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:54:30 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a8b5b28a-5718-4299-98ad-644f88b1d40b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:54:30 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-a8b5b28a-5718-4299-98ad-644f88b1d40b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:54:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a8b5b28a-5718-4299-98ad-644f88b1d40b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-3cebcf94-26f6-44b5-bb08-2b6155bf405a 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:30 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-7fd9b0c9-5362-4158-a57d-a5b7a35a7588 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb8f829a-bb7d-489d-ad57-ddebdcd7b7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69dc6907-843d-467f-bfed-9992a03f3187', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:30 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-7fd9b0c9-5362-4158-a57d-a5b7a35a7588 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ec1f0ba-7ce7-4f57-ab18-fb7a65865ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:30 devstack sudo[89334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-3cebcf94-26f6-44b5-bb08-2b6155bf405a 1073741824 Apr 24 13:54:30 devstack sudo[89334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:30 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-7fd9b0c9-5362-4158-a57d-a5b7a35a7588 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Volume volume-69dc6907-843d-467f-bfed-9992a03f3187 (69dc6907-843d-467f-bfed-9992a03f3187): created successfully Apr 24 13:54:30 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-7fd9b0c9-5362-4158-a57d-a5b7a35a7588 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ec1f0ba-7ce7-4f57-ab18-fb7a65865ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:30 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-7fd9b0c9-5362-4158-a57d-a5b7a35a7588 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Flow 'volume_create_manager' (48be2302-b8e8-43c3-94d9-ad00cc84483b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:54:30 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-7fd9b0c9-5362-4158-a57d-a5b7a35a7588 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Created volume successfully. Apr 24 13:54:31 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-a09fd97c-f332-4c6e-9af5-f68c8dc724d1 tempest-SnapshotMetadataTestJSON-314085606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:54:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a09fd97c-f332-4c6e-9af5-f68c8dc724d1 tempest-SnapshotMetadataTestJSON-314085606 None] Flow 'volume_create_manager' (305ac98a-991c-48ec-bf20-a74148639a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:54:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a09fd97c-f332-4c6e-9af5-f68c8dc724d1 tempest-SnapshotMetadataTestJSON-314085606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a1c7a85-3191-41c2-8e28-17f351cf9d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:31 devstack sudo[89334]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a8b5b28a-5718-4299-98ad-644f88b1d40b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-3cebcf94-26f6-44b5-bb08-2b6155bf405a 1073741824" returned: 0 in 1.004s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a09fd97c-f332-4c6e-9af5-f68c8dc724d1 tempest-SnapshotMetadataTestJSON-314085606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a1c7a85-3191-41c2-8e28-17f351cf9d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-960548490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=318508cc-9be8-4030-b0a2-52efdaeff649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='193958342cfe4a2c9f1ed227de63b9dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:54:31Z,use_quota=True,user_id='03cd8bf9444146cdbd08d746b3e6a219',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a09fd97c-f332-4c6e-9af5-f68c8dc724d1 tempest-SnapshotMetadataTestJSON-314085606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67ca60be-875a-44d8-a516-ab1883b7ea88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a09fd97c-f332-4c6e-9af5-f68c8dc724d1 tempest-SnapshotMetadataTestJSON-314085606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67ca60be-875a-44d8-a516-ab1883b7ea88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a09fd97c-f332-4c6e-9af5-f68c8dc724d1 tempest-SnapshotMetadataTestJSON-314085606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2f94247-9c39-4b1f-9d56-bab790ca463f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a09fd97c-f332-4c6e-9af5-f68c8dc724d1 tempest-SnapshotMetadataTestJSON-314085606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2f94247-9c39-4b1f-9d56-bab790ca463f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '318508cc-9be8-4030-b0a2-52efdaeff649', 'volume_name': 'volume-318508cc-9be8-4030-b0a2-52efdaeff649', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a09fd97c-f332-4c6e-9af5-f68c8dc724d1 tempest-SnapshotMetadataTestJSON-314085606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef91b4f0-eb4b-4906-a371-5e78d196a502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a09fd97c-f332-4c6e-9af5-f68c8dc724d1 tempest-SnapshotMetadataTestJSON-314085606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef91b4f0-eb4b-4906-a371-5e78d196a502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a09fd97c-f332-4c6e-9af5-f68c8dc724d1 tempest-SnapshotMetadataTestJSON-314085606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c10c97c5-813d-4555-a737-a2fc7b190eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:31 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-a09fd97c-f332-4c6e-9af5-f68c8dc724d1 tempest-SnapshotMetadataTestJSON-314085606 None] Volume 318508cc-9be8-4030-b0a2-52efdaeff649: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-318508cc-9be8-4030-b0a2-52efdaeff649', 'volume_size': 1} Apr 24 13:54:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a09fd97c-f332-4c6e-9af5-f68c8dc724d1 tempest-SnapshotMetadataTestJSON-314085606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:54:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a8b5b28a-5718-4299-98ad-644f88b1d40b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-3cebcf94-26f6-44b5-bb08-2b6155bf405a {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:31 devstack sudo[89339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-3cebcf94-26f6-44b5-bb08-2b6155bf405a Apr 24 13:54:31 devstack sudo[89339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:31 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-2aa98a86-d9ee-447f-9485-1cb2312f2b68 tempest-SnapshotDependencyTests-618444304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:54:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-2aa98a86-d9ee-447f-9485-1cb2312f2b68 tempest-SnapshotDependencyTests-618444304 None] Flow 'volume_create_manager' (e66da8bc-88db-4ad7-81d1-1c86ce58de7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:54:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-2aa98a86-d9ee-447f-9485-1cb2312f2b68 tempest-SnapshotDependencyTests-618444304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c72b7864-1326-422d-a15b-cf77f21fecb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-2aa98a86-d9ee-447f-9485-1cb2312f2b68 tempest-SnapshotDependencyTests-618444304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c72b7864-1326-422d-a15b-cf77f21fecb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-55641439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dbac441-f3b3-4468-999b-04534bebf48d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2281cda3285410ab129619c0666a11d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:54:31Z,use_quota=True,user_id='6efe66b86392472c9fd87a5cbd9ed5ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-2aa98a86-d9ee-447f-9485-1cb2312f2b68 tempest-SnapshotDependencyTests-618444304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caef9725-97d6-4417-838c-2c1a28a01103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-2aa98a86-d9ee-447f-9485-1cb2312f2b68 tempest-SnapshotDependencyTests-618444304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caef9725-97d6-4417-838c-2c1a28a01103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-2aa98a86-d9ee-447f-9485-1cb2312f2b68 tempest-SnapshotDependencyTests-618444304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61cfaa96-ae25-4e66-9bdc-3cfa040e6f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-2aa98a86-d9ee-447f-9485-1cb2312f2b68 tempest-SnapshotDependencyTests-618444304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61cfaa96-ae25-4e66-9bdc-3cfa040e6f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dbac441-f3b3-4468-999b-04534bebf48d', 'volume_name': 'volume-0dbac441-f3b3-4468-999b-04534bebf48d', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-2aa98a86-d9ee-447f-9485-1cb2312f2b68 tempest-SnapshotDependencyTests-618444304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61b00fa1-dd67-4720-922d-d797bce86b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-2aa98a86-d9ee-447f-9485-1cb2312f2b68 tempest-SnapshotDependencyTests-618444304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61b00fa1-dd67-4720-922d-d797bce86b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-2aa98a86-d9ee-447f-9485-1cb2312f2b68 tempest-SnapshotDependencyTests-618444304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7616cb8-ba54-4df5-8054-63259480e491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:31 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-2aa98a86-d9ee-447f-9485-1cb2312f2b68 tempest-SnapshotDependencyTests-618444304 None] Volume 0dbac441-f3b3-4468-999b-04534bebf48d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dbac441-f3b3-4468-999b-04534bebf48d', 'volume_size': 1} Apr 24 13:54:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-2aa98a86-d9ee-447f-9485-1cb2312f2b68 tempest-SnapshotDependencyTests-618444304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:54:31 devstack sudo[89339]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a8b5b28a-5718-4299-98ad-644f88b1d40b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-3cebcf94-26f6-44b5-bb08-2b6155bf405a" returned: 0 in 0.468s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:31 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a8b5b28a-5718-4299-98ad-644f88b1d40b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] <== create_volume: return (1581ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:54:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a8b5b28a-5718-4299-98ad-644f88b1d40b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.601s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:54:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5a75c4ef-c9cf-4ec0-8165-567a3b855cb2 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.594s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:54:31 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-5a75c4ef-c9cf-4ec0-8165-567a3b855cb2 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1056139279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f4f8012-f642-483c-9d46-df489fbd673c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e338464d41754fa99e7d495b73f16331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:54:29Z,use_quota=True,user_id='970cb501f658426c8981ba3bc6c859f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:54:31 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-5a75c4ef-c9cf-4ec0-8165-567a3b855cb2 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Creating volume 1f4f8012-f642-483c-9d46-df489fbd673c {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:54:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5a75c4ef-c9cf-4ec0-8165-567a3b855cb2 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:54:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5a75c4ef-c9cf-4ec0-8165-567a3b855cb2 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:54:31 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-5a75c4ef-c9cf-4ec0-8165-567a3b855cb2 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:54:31 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-5a75c4ef-c9cf-4ec0-8165-567a3b855cb2 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:54:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5a75c4ef-c9cf-4ec0-8165-567a3b855cb2 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:54:31 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-5a75c4ef-c9cf-4ec0-8165-567a3b855cb2 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:54:31 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-5a75c4ef-c9cf-4ec0-8165-567a3b855cb2 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:54:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5a75c4ef-c9cf-4ec0-8165-567a3b855cb2 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1f4f8012-f642-483c-9d46-df489fbd673c 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:31 devstack sudo[89342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1f4f8012-f642-483c-9d46-df489fbd673c 1073741824 Apr 24 13:54:31 devstack sudo[89342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a8b5b28a-5718-4299-98ad-644f88b1d40b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30e908dc-9224-4180-808f-6503f2d1b228) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cebcf94-26f6-44b5-bb08-2b6155bf405a', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a8b5b28a-5718-4299-98ad-644f88b1d40b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bf532df-adc0-4c3e-b0d4-152b41b587d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:31 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-a8b5b28a-5718-4299-98ad-644f88b1d40b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Volume volume-3cebcf94-26f6-44b5-bb08-2b6155bf405a (3cebcf94-26f6-44b5-bb08-2b6155bf405a): created successfully Apr 24 13:54:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a8b5b28a-5718-4299-98ad-644f88b1d40b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bf532df-adc0-4c3e-b0d4-152b41b587d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a8b5b28a-5718-4299-98ad-644f88b1d40b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Flow 'volume_create_manager' (52db004e-fa0e-4d0d-b737-9e2fe61249ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:54:31 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-a8b5b28a-5718-4299-98ad-644f88b1d40b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Created volume successfully. Apr 24 13:54:32 devstack sudo[89342]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5a75c4ef-c9cf-4ec0-8165-567a3b855cb2 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1f4f8012-f642-483c-9d46-df489fbd673c 1073741824" returned: 0 in 0.686s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5a75c4ef-c9cf-4ec0-8165-567a3b855cb2 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1f4f8012-f642-483c-9d46-df489fbd673c {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:32 devstack sudo[89347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1f4f8012-f642-483c-9d46-df489fbd673c Apr 24 13:54:32 devstack sudo[89347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:32 devstack sudo[89347]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5a75c4ef-c9cf-4ec0-8165-567a3b855cb2 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1f4f8012-f642-483c-9d46-df489fbd673c" returned: 0 in 0.452s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:32 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-5a75c4ef-c9cf-4ec0-8165-567a3b855cb2 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:54:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5a75c4ef-c9cf-4ec0-8165-567a3b855cb2 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:54:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-856f4d1d-8e16-4fed-b445-73cde393726d tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.370s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:54:32 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-856f4d1d-8e16-4fed-b445-73cde393726d tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2044741727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f3ed6f9-41ce-44da-9df0-48cb45b0b466,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e338464d41754fa99e7d495b73f16331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:54:29Z,use_quota=True,user_id='970cb501f658426c8981ba3bc6c859f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:54:32 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-856f4d1d-8e16-4fed-b445-73cde393726d tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Creating volume 7f3ed6f9-41ce-44da-9df0-48cb45b0b466 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:54:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-856f4d1d-8e16-4fed-b445-73cde393726d tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:54:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-856f4d1d-8e16-4fed-b445-73cde393726d tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:54:32 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-856f4d1d-8e16-4fed-b445-73cde393726d tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:54:32 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-856f4d1d-8e16-4fed-b445-73cde393726d tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:54:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-856f4d1d-8e16-4fed-b445-73cde393726d tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:54:32 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-856f4d1d-8e16-4fed-b445-73cde393726d tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:54:32 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-856f4d1d-8e16-4fed-b445-73cde393726d tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:54:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-856f4d1d-8e16-4fed-b445-73cde393726d tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7f3ed6f9-41ce-44da-9df0-48cb45b0b466 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:32 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5a75c4ef-c9cf-4ec0-8165-567a3b855cb2 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfac530b-36ef-499c-832c-8bd69aa31a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f4f8012-f642-483c-9d46-df489fbd673c', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:32 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5a75c4ef-c9cf-4ec0-8165-567a3b855cb2 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4202c165-8af9-466f-9239-1d6be97be0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:32 devstack sudo[89351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7f3ed6f9-41ce-44da-9df0-48cb45b0b466 1073741824 Apr 24 13:54:32 devstack sudo[89351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:32 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-5a75c4ef-c9cf-4ec0-8165-567a3b855cb2 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Volume volume-1f4f8012-f642-483c-9d46-df489fbd673c (1f4f8012-f642-483c-9d46-df489fbd673c): created successfully Apr 24 13:54:32 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5a75c4ef-c9cf-4ec0-8165-567a3b855cb2 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4202c165-8af9-466f-9239-1d6be97be0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:32 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5a75c4ef-c9cf-4ec0-8165-567a3b855cb2 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Flow 'volume_create_manager' (e390098b-5b0d-4a49-9914-defae97bc073) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:54:32 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-5a75c4ef-c9cf-4ec0-8165-567a3b855cb2 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Created volume successfully. Apr 24 13:54:33 devstack sudo[89351]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-856f4d1d-8e16-4fed-b445-73cde393726d tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7f3ed6f9-41ce-44da-9df0-48cb45b0b466 1073741824" returned: 0 in 0.690s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-856f4d1d-8e16-4fed-b445-73cde393726d tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7f3ed6f9-41ce-44da-9df0-48cb45b0b466 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:33 devstack sudo[89357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7f3ed6f9-41ce-44da-9df0-48cb45b0b466 Apr 24 13:54:33 devstack sudo[89357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:34 devstack sudo[89357]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-856f4d1d-8e16-4fed-b445-73cde393726d tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7f3ed6f9-41ce-44da-9df0-48cb45b0b466" returned: 0 in 0.453s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:34 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-856f4d1d-8e16-4fed-b445-73cde393726d tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:54:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-856f4d1d-8e16-4fed-b445-73cde393726d tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:54:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-af151c89-2b9b-425b-8d32-1dc51928dfc9 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.196s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:54:34 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-af151c89-2b9b-425b-8d32-1dc51928dfc9 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-618900949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3db7c004-c5a3-44a8-8554-6a3d992ff53a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e338464d41754fa99e7d495b73f16331',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:54:30Z,use_quota=True,user_id='970cb501f658426c8981ba3bc6c859f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:54:34 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-af151c89-2b9b-425b-8d32-1dc51928dfc9 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Creating volume 3db7c004-c5a3-44a8-8554-6a3d992ff53a {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:54:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-af151c89-2b9b-425b-8d32-1dc51928dfc9 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:54:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-af151c89-2b9b-425b-8d32-1dc51928dfc9 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:54:34 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-af151c89-2b9b-425b-8d32-1dc51928dfc9 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:54:34 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-af151c89-2b9b-425b-8d32-1dc51928dfc9 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:54:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-af151c89-2b9b-425b-8d32-1dc51928dfc9 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:54:34 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-af151c89-2b9b-425b-8d32-1dc51928dfc9 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:54:34 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-af151c89-2b9b-425b-8d32-1dc51928dfc9 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:54:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-af151c89-2b9b-425b-8d32-1dc51928dfc9 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-3db7c004-c5a3-44a8-8554-6a3d992ff53a 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:34 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-856f4d1d-8e16-4fed-b445-73cde393726d tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (537b342e-c007-4906-a182-b27c38ffe12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f3ed6f9-41ce-44da-9df0-48cb45b0b466', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:34 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-856f4d1d-8e16-4fed-b445-73cde393726d tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de8ddf20-871a-4db9-ba2c-00460a2eb768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:34 devstack sudo[89360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-3db7c004-c5a3-44a8-8554-6a3d992ff53a 1073741824 Apr 24 13:54:34 devstack sudo[89360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:34 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-856f4d1d-8e16-4fed-b445-73cde393726d tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Volume volume-7f3ed6f9-41ce-44da-9df0-48cb45b0b466 (7f3ed6f9-41ce-44da-9df0-48cb45b0b466): created successfully Apr 24 13:54:34 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-856f4d1d-8e16-4fed-b445-73cde393726d tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de8ddf20-871a-4db9-ba2c-00460a2eb768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:34 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-856f4d1d-8e16-4fed-b445-73cde393726d tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Flow 'volume_create_manager' (ee5b2ce6-2f67-4cc4-8729-8c412a197c8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:54:34 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-856f4d1d-8e16-4fed-b445-73cde393726d tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Created volume successfully. Apr 24 13:54:34 devstack sudo[89360]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-af151c89-2b9b-425b-8d32-1dc51928dfc9 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-3db7c004-c5a3-44a8-8554-6a3d992ff53a 1073741824" returned: 0 in 0.632s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-af151c89-2b9b-425b-8d32-1dc51928dfc9 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-3db7c004-c5a3-44a8-8554-6a3d992ff53a {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:34 devstack sudo[89365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-3db7c004-c5a3-44a8-8554-6a3d992ff53a Apr 24 13:54:34 devstack sudo[89365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:35 devstack sudo[89365]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-af151c89-2b9b-425b-8d32-1dc51928dfc9 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-3db7c004-c5a3-44a8-8554-6a3d992ff53a" returned: 0 in 0.516s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:35 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-af151c89-2b9b-425b-8d32-1dc51928dfc9 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:54:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-af151c89-2b9b-425b-8d32-1dc51928dfc9 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:54:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a09fd97c-f332-4c6e-9af5-f68c8dc724d1 tempest-SnapshotMetadataTestJSON-314085606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.085s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:54:35 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a09fd97c-f332-4c6e-9af5-f68c8dc724d1 tempest-SnapshotMetadataTestJSON-314085606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-960548490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=318508cc-9be8-4030-b0a2-52efdaeff649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='193958342cfe4a2c9f1ed227de63b9dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:54:31Z,use_quota=True,user_id='03cd8bf9444146cdbd08d746b3e6a219',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:54:35 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-a09fd97c-f332-4c6e-9af5-f68c8dc724d1 tempest-SnapshotMetadataTestJSON-314085606 None] Creating volume 318508cc-9be8-4030-b0a2-52efdaeff649 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:54:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a09fd97c-f332-4c6e-9af5-f68c8dc724d1 tempest-SnapshotMetadataTestJSON-314085606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:54:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a09fd97c-f332-4c6e-9af5-f68c8dc724d1 tempest-SnapshotMetadataTestJSON-314085606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:54:35 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a09fd97c-f332-4c6e-9af5-f68c8dc724d1 tempest-SnapshotMetadataTestJSON-314085606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:54:35 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a09fd97c-f332-4c6e-9af5-f68c8dc724d1 tempest-SnapshotMetadataTestJSON-314085606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:54:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a09fd97c-f332-4c6e-9af5-f68c8dc724d1 tempest-SnapshotMetadataTestJSON-314085606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:54:35 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a09fd97c-f332-4c6e-9af5-f68c8dc724d1 tempest-SnapshotMetadataTestJSON-314085606 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:54:35 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-a09fd97c-f332-4c6e-9af5-f68c8dc724d1 tempest-SnapshotMetadataTestJSON-314085606 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:54:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a09fd97c-f332-4c6e-9af5-f68c8dc724d1 tempest-SnapshotMetadataTestJSON-314085606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-318508cc-9be8-4030-b0a2-52efdaeff649 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:35 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-af151c89-2b9b-425b-8d32-1dc51928dfc9 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8017e9e-e5eb-4730-953c-551b76ece80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3db7c004-c5a3-44a8-8554-6a3d992ff53a', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:35 devstack sudo[89368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-318508cc-9be8-4030-b0a2-52efdaeff649 1073741824 Apr 24 13:54:35 devstack sudo[89368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:35 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-af151c89-2b9b-425b-8d32-1dc51928dfc9 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (846853d6-9d4d-4186-99f5-314da14ce994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:35 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-af151c89-2b9b-425b-8d32-1dc51928dfc9 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Volume volume-3db7c004-c5a3-44a8-8554-6a3d992ff53a (3db7c004-c5a3-44a8-8554-6a3d992ff53a): created successfully Apr 24 13:54:35 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-af151c89-2b9b-425b-8d32-1dc51928dfc9 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (846853d6-9d4d-4186-99f5-314da14ce994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:35 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-af151c89-2b9b-425b-8d32-1dc51928dfc9 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Flow 'volume_create_manager' (785ab168-c883-4585-a026-fb45fe3494ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:54:35 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-af151c89-2b9b-425b-8d32-1dc51928dfc9 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Created volume successfully. Apr 24 13:54:35 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-957dc0c1-dd08-4f91-83d3-b89f194fb1e1 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Acquiring lock "cinder-3db7c004-c5a3-44a8-8554-6a3d992ff53a-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:54:35 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-957dc0c1-dd08-4f91-83d3-b89f194fb1e1 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "cinder-3db7c004-c5a3-44a8-8554-6a3d992ff53a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:54:35 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-957dc0c1-dd08-4f91-83d3-b89f194fb1e1 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Acquiring lock "cinder-quobyte-3db7c004-c5a3-44a8-8554-6a3d992ff53a" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:54:35 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-957dc0c1-dd08-4f91-83d3-b89f194fb1e1 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "cinder-quobyte-3db7c004-c5a3-44a8-8554-6a3d992ff53a" acquired by "delete_volume" :: waited 0.016s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:54:35 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[68805da7-7473-4a58-859e-74020acff905]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:54:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-957dc0c1-dd08-4f91-83d3-b89f194fb1e1 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-3db7c004-c5a3-44a8-8554-6a3d992ff53a {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:35 devstack sudo[89374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-3db7c004-c5a3-44a8-8554-6a3d992ff53a Apr 24 13:54:35 devstack sudo[89374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:36 devstack sudo[89368]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a09fd97c-f332-4c6e-9af5-f68c8dc724d1 tempest-SnapshotMetadataTestJSON-314085606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-318508cc-9be8-4030-b0a2-52efdaeff649 1073741824" returned: 0 in 0.820s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a09fd97c-f332-4c6e-9af5-f68c8dc724d1 tempest-SnapshotMetadataTestJSON-314085606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-318508cc-9be8-4030-b0a2-52efdaeff649 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:36 devstack sudo[89376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-318508cc-9be8-4030-b0a2-52efdaeff649 Apr 24 13:54:36 devstack sudo[89376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:36 devstack sudo[89374]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-957dc0c1-dd08-4f91-83d3-b89f194fb1e1 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-3db7c004-c5a3-44a8-8554-6a3d992ff53a" returned: 0 in 0.701s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-957dc0c1-dd08-4f91-83d3-b89f194fb1e1 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-3db7c004-c5a3-44a8-8554-6a3d992ff53a {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:36 devstack sudo[89381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-3db7c004-c5a3-44a8-8554-6a3d992ff53a Apr 24 13:54:36 devstack sudo[89381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a09fd97c-f332-4c6e-9af5-f68c8dc724d1 tempest-SnapshotMetadataTestJSON-314085606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-318508cc-9be8-4030-b0a2-52efdaeff649" returned: 0 in 0.514s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:36 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a09fd97c-f332-4c6e-9af5-f68c8dc724d1 tempest-SnapshotMetadataTestJSON-314085606 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:54:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a09fd97c-f332-4c6e-9af5-f68c8dc724d1 tempest-SnapshotMetadataTestJSON-314085606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.382s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:54:36 devstack sudo[89376]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-2aa98a86-d9ee-447f-9485-1cb2312f2b68 tempest-SnapshotDependencyTests-618444304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.175s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:54:36 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-2aa98a86-d9ee-447f-9485-1cb2312f2b68 tempest-SnapshotDependencyTests-618444304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-55641439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dbac441-f3b3-4468-999b-04534bebf48d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2281cda3285410ab129619c0666a11d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:54:31Z,use_quota=True,user_id='6efe66b86392472c9fd87a5cbd9ed5ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:54:36 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-2aa98a86-d9ee-447f-9485-1cb2312f2b68 tempest-SnapshotDependencyTests-618444304 None] Creating volume 0dbac441-f3b3-4468-999b-04534bebf48d {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:54:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-2aa98a86-d9ee-447f-9485-1cb2312f2b68 tempest-SnapshotDependencyTests-618444304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:54:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-2aa98a86-d9ee-447f-9485-1cb2312f2b68 tempest-SnapshotDependencyTests-618444304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:54:36 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-2aa98a86-d9ee-447f-9485-1cb2312f2b68 tempest-SnapshotDependencyTests-618444304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:54:36 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-2aa98a86-d9ee-447f-9485-1cb2312f2b68 tempest-SnapshotDependencyTests-618444304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:54:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-2aa98a86-d9ee-447f-9485-1cb2312f2b68 tempest-SnapshotDependencyTests-618444304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:54:36 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-2aa98a86-d9ee-447f-9485-1cb2312f2b68 tempest-SnapshotDependencyTests-618444304 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:54:36 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-2aa98a86-d9ee-447f-9485-1cb2312f2b68 tempest-SnapshotDependencyTests-618444304 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:54:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2aa98a86-d9ee-447f-9485-1cb2312f2b68 tempest-SnapshotDependencyTests-618444304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:36 devstack sudo[89384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d 1073741824 Apr 24 13:54:36 devstack sudo[89384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:36 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a09fd97c-f332-4c6e-9af5-f68c8dc724d1 tempest-SnapshotMetadataTestJSON-314085606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c10c97c5-813d-4555-a737-a2fc7b190eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-318508cc-9be8-4030-b0a2-52efdaeff649', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:36 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a09fd97c-f332-4c6e-9af5-f68c8dc724d1 tempest-SnapshotMetadataTestJSON-314085606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca880d6c-e03e-4a0e-b8cb-0b0998ea4b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:36 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-a09fd97c-f332-4c6e-9af5-f68c8dc724d1 tempest-SnapshotMetadataTestJSON-314085606 None] Volume volume-318508cc-9be8-4030-b0a2-52efdaeff649 (318508cc-9be8-4030-b0a2-52efdaeff649): created successfully Apr 24 13:54:36 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a09fd97c-f332-4c6e-9af5-f68c8dc724d1 tempest-SnapshotMetadataTestJSON-314085606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca880d6c-e03e-4a0e-b8cb-0b0998ea4b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:36 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a09fd97c-f332-4c6e-9af5-f68c8dc724d1 tempest-SnapshotMetadataTestJSON-314085606 None] Flow 'volume_create_manager' (305ac98a-991c-48ec-bf20-a74148639a9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:54:36 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-a09fd97c-f332-4c6e-9af5-f68c8dc724d1 tempest-SnapshotMetadataTestJSON-314085606 None] Created volume successfully. Apr 24 13:54:37 devstack sudo[89381]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-957dc0c1-dd08-4f91-83d3-b89f194fb1e1 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-3db7c004-c5a3-44a8-8554-6a3d992ff53a" returned: 0 in 0.529s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:37 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-957dc0c1-dd08-4f91-83d3-b89f194fb1e1 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "cinder-quobyte-3db7c004-c5a3-44a8-8554-6a3d992ff53a" released by "delete_volume" :: held 1.278s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:54:37 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-957dc0c1-dd08-4f91-83d3-b89f194fb1e1 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Created reservations ['d4d429dc-e054-4442-a1c1-91d78e693d6b', '5dd296b0-3d48-41de-b3a8-e3e87640520b', '5f9f7aae-1af3-4f40-b7d9-2e4803bdbc51', '1f900bcc-69c0-42e8-be76-c56862d29ddc'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:54:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-957dc0c1-dd08-4f91-83d3-b89f194fb1e1 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:54:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-957dc0c1-dd08-4f91-83d3-b89f194fb1e1 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:54:37 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-957dc0c1-dd08-4f91-83d3-b89f194fb1e1 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:54:37 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-957dc0c1-dd08-4f91-83d3-b89f194fb1e1 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:54:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-957dc0c1-dd08-4f91-83d3-b89f194fb1e1 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:54:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-957dc0c1-dd08-4f91-83d3-b89f194fb1e1 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:37 devstack sudo[89390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:54:37 devstack sudo[89390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:37 devstack sudo[89384]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2aa98a86-d9ee-447f-9485-1cb2312f2b68 tempest-SnapshotDependencyTests-618444304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d 1073741824" returned: 0 in 0.813s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2aa98a86-d9ee-447f-9485-1cb2312f2b68 tempest-SnapshotDependencyTests-618444304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:37 devstack sudo[89392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d Apr 24 13:54:37 devstack sudo[89392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:37 devstack sudo[89390]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-957dc0c1-dd08-4f91-83d3-b89f194fb1e1 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.562s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:37 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-957dc0c1-dd08-4f91-83d3-b89f194fb1e1 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:54:37 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-957dc0c1-dd08-4f91-83d3-b89f194fb1e1 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Deleted volume successfully. Apr 24 13:54:37 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-957dc0c1-dd08-4f91-83d3-b89f194fb1e1 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "cinder-3db7c004-c5a3-44a8-8554-6a3d992ff53a-delete_volume" released by "delete_volume" :: held 2.093s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:54:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-faecec03-456e-4f96-9c0a-a64d4d3a5286 tempest-SnapshotMetadataTestJSON-314085606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:54:37 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-caed526d-4f5a-491c-b013-fab99b32d21b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Acquiring lock "cinder-7f3ed6f9-41ce-44da-9df0-48cb45b0b466-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:54:38 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-caed526d-4f5a-491c-b013-fab99b32d21b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "cinder-7f3ed6f9-41ce-44da-9df0-48cb45b0b466-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:54:38 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-caed526d-4f5a-491c-b013-fab99b32d21b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Acquiring lock "cinder-quobyte-7f3ed6f9-41ce-44da-9df0-48cb45b0b466" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:54:38 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-caed526d-4f5a-491c-b013-fab99b32d21b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "cinder-quobyte-7f3ed6f9-41ce-44da-9df0-48cb45b0b466" acquired by "delete_volume" :: waited 0.017s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:54:38 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[469915f9-eb9c-41f7-b5cb-ca6f8f506e60]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:54:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-caed526d-4f5a-491c-b013-fab99b32d21b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7f3ed6f9-41ce-44da-9df0-48cb45b0b466 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:38 devstack sudo[89396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7f3ed6f9-41ce-44da-9df0-48cb45b0b466 Apr 24 13:54:38 devstack sudo[89396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:38 devstack sudo[89392]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2aa98a86-d9ee-447f-9485-1cb2312f2b68 tempest-SnapshotDependencyTests-618444304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d" returned: 0 in 0.608s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:38 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-2aa98a86-d9ee-447f-9485-1cb2312f2b68 tempest-SnapshotDependencyTests-618444304 None] <== create_volume: return (1473ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:54:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-2aa98a86-d9ee-447f-9485-1cb2312f2b68 tempest-SnapshotDependencyTests-618444304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.476s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:54:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-faecec03-456e-4f96-9c0a-a64d4d3a5286 tempest-SnapshotMetadataTestJSON-314085606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.352s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:54:38 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-faecec03-456e-4f96-9c0a-a64d4d3a5286 tempest-SnapshotMetadataTestJSON-314085606 None] Creating offline snapshot ee02bf2a-c13a-4834-9fa5-30d0e24edb9a of volume 318508cc-9be8-4030-b0a2-52efdaeff649 {{(pid=82046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 13:54:38 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-2aa98a86-d9ee-447f-9485-1cb2312f2b68 tempest-SnapshotDependencyTests-618444304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7616cb8-ba54-4df5-8054-63259480e491) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dbac441-f3b3-4468-999b-04534bebf48d', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:38 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-2aa98a86-d9ee-447f-9485-1cb2312f2b68 tempest-SnapshotDependencyTests-618444304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88c4deb8-ee33-43c0-888b-95ffd0bae396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:38 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df9e1ae-915c-4950-b796-7e52b4190496]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:54:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-faecec03-456e-4f96-9c0a-a64d4d3a5286 tempest-SnapshotMetadataTestJSON-314085606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-318508cc-9be8-4030-b0a2-52efdaeff649 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:38 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-2aa98a86-d9ee-447f-9485-1cb2312f2b68 tempest-SnapshotDependencyTests-618444304 None] Volume volume-0dbac441-f3b3-4468-999b-04534bebf48d (0dbac441-f3b3-4468-999b-04534bebf48d): created successfully Apr 24 13:54:38 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-2aa98a86-d9ee-447f-9485-1cb2312f2b68 tempest-SnapshotDependencyTests-618444304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88c4deb8-ee33-43c0-888b-95ffd0bae396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:38 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-2aa98a86-d9ee-447f-9485-1cb2312f2b68 tempest-SnapshotDependencyTests-618444304 None] Flow 'volume_create_manager' (e66da8bc-88db-4ad7-81d1-1c86ce58de7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:54:38 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-2aa98a86-d9ee-447f-9485-1cb2312f2b68 tempest-SnapshotDependencyTests-618444304 None] Created volume successfully. Apr 24 13:54:38 devstack sudo[89399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-318508cc-9be8-4030-b0a2-52efdaeff649 Apr 24 13:54:38 devstack sudo[89399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:38 devstack sudo[89396]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-caed526d-4f5a-491c-b013-fab99b32d21b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7f3ed6f9-41ce-44da-9df0-48cb45b0b466" returned: 0 in 0.551s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-caed526d-4f5a-491c-b013-fab99b32d21b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7f3ed6f9-41ce-44da-9df0-48cb45b0b466 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:38 devstack sudo[89404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7f3ed6f9-41ce-44da-9df0-48cb45b0b466 Apr 24 13:54:38 devstack sudo[89404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:38 devstack sudo[89399]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-faecec03-456e-4f96-9c0a-a64d4d3a5286 tempest-SnapshotMetadataTestJSON-314085606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-318508cc-9be8-4030-b0a2-52efdaeff649" returned: 0 in 0.615s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-faecec03-456e-4f96-9c0a-a64d4d3a5286 tempest-SnapshotMetadataTestJSON-314085606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-318508cc-9be8-4030-b0a2-52efdaeff649,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-318508cc-9be8-4030-b0a2-52efdaeff649.ee02bf2a-c13a-4834-9fa5-30d0e24edb9a 1G {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:38 devstack sudo[89409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-318508cc-9be8-4030-b0a2-52efdaeff649,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-318508cc-9be8-4030-b0a2-52efdaeff649.ee02bf2a-c13a-4834-9fa5-30d0e24edb9a 1G Apr 24 13:54:38 devstack sudo[89409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-9e47fa71-b3c9-4e8d-8d4f-8416a2455f39 tempest-SnapshotDependencyTests-618444304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:54:39 devstack sudo[89404]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-caed526d-4f5a-491c-b013-fab99b32d21b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7f3ed6f9-41ce-44da-9df0-48cb45b0b466" returned: 0 in 0.614s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:39 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-caed526d-4f5a-491c-b013-fab99b32d21b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "cinder-quobyte-7f3ed6f9-41ce-44da-9df0-48cb45b0b466" released by "delete_volume" :: held 1.206s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:54:39 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-caed526d-4f5a-491c-b013-fab99b32d21b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Created reservations ['2bb693ab-04d7-427c-bee1-0c82986aa6a2', '1f990956-ab7a-417a-938d-8b7231a20bb4', '86e7e42a-cfd6-4064-8295-0e7e9dcc614e', '9fb89275-c25a-4cb9-b60e-6df483999fd6'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:54:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-caed526d-4f5a-491c-b013-fab99b32d21b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:54:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-caed526d-4f5a-491c-b013-fab99b32d21b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:54:39 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-caed526d-4f5a-491c-b013-fab99b32d21b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:54:39 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-caed526d-4f5a-491c-b013-fab99b32d21b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:54:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-caed526d-4f5a-491c-b013-fab99b32d21b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:54:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-caed526d-4f5a-491c-b013-fab99b32d21b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:39 devstack sudo[89415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:54:39 devstack sudo[89415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:39 devstack sudo[89409]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-faecec03-456e-4f96-9c0a-a64d4d3a5286 tempest-SnapshotMetadataTestJSON-314085606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-318508cc-9be8-4030-b0a2-52efdaeff649,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-318508cc-9be8-4030-b0a2-52efdaeff649.ee02bf2a-c13a-4834-9fa5-30d0e24edb9a 1G" returned: 0 in 0.701s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-faecec03-456e-4f96-9c0a-a64d4d3a5286 tempest-SnapshotMetadataTestJSON-314085606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-318508cc-9be8-4030-b0a2-52efdaeff649 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-318508cc-9be8-4030-b0a2-52efdaeff649.ee02bf2a-c13a-4834-9fa5-30d0e24edb9a {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:39 devstack sudo[89417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-318508cc-9be8-4030-b0a2-52efdaeff649 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-318508cc-9be8-4030-b0a2-52efdaeff649.ee02bf2a-c13a-4834-9fa5-30d0e24edb9a Apr 24 13:54:39 devstack sudo[89417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:39 devstack sudo[89415]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-caed526d-4f5a-491c-b013-fab99b32d21b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.483s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:39 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-caed526d-4f5a-491c-b013-fab99b32d21b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:54:39 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-caed526d-4f5a-491c-b013-fab99b32d21b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Deleted volume successfully. Apr 24 13:54:39 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-caed526d-4f5a-491c-b013-fab99b32d21b tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "cinder-7f3ed6f9-41ce-44da-9df0-48cb45b0b466-delete_volume" released by "delete_volume" :: held 1.951s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:54:40 devstack sudo[89417]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:40 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-faecec03-456e-4f96-9c0a-a64d4d3a5286 tempest-SnapshotMetadataTestJSON-314085606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-318508cc-9be8-4030-b0a2-52efdaeff649 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-318508cc-9be8-4030-b0a2-52efdaeff649.ee02bf2a-c13a-4834-9fa5-30d0e24edb9a" returned: 0 in 0.536s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:40 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-faecec03-456e-4f96-9c0a-a64d4d3a5286 tempest-SnapshotMetadataTestJSON-314085606 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-318508cc-9be8-4030-b0a2-52efdaeff649.ee02bf2a-c13a-4834-9fa5-30d0e24edb9a is being set with open permissions: ugo+rw Apr 24 13:54:40 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-faecec03-456e-4f96-9c0a-a64d4d3a5286 tempest-SnapshotMetadataTestJSON-314085606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-318508cc-9be8-4030-b0a2-52efdaeff649.ee02bf2a-c13a-4834-9fa5-30d0e24edb9a {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:40 devstack sudo[89423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-318508cc-9be8-4030-b0a2-52efdaeff649.ee02bf2a-c13a-4834-9fa5-30d0e24edb9a Apr 24 13:54:40 devstack sudo[89423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:40 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-57dfe336-ce1a-451f-9e2a-1c0da440bbcb tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Acquiring lock "cinder-1f4f8012-f642-483c-9d46-df489fbd673c-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:54:40 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-57dfe336-ce1a-451f-9e2a-1c0da440bbcb tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "cinder-1f4f8012-f642-483c-9d46-df489fbd673c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:54:40 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-57dfe336-ce1a-451f-9e2a-1c0da440bbcb tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Acquiring lock "cinder-quobyte-1f4f8012-f642-483c-9d46-df489fbd673c" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:54:40 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-57dfe336-ce1a-451f-9e2a-1c0da440bbcb tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "cinder-quobyte-1f4f8012-f642-483c-9d46-df489fbd673c" acquired by "delete_volume" :: waited 0.012s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:54:40 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a700d3b-755c-4ce7-90cf-15b7e7c758c1]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:54:40 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-57dfe336-ce1a-451f-9e2a-1c0da440bbcb tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1f4f8012-f642-483c-9d46-df489fbd673c {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:40 devstack sudo[89425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1f4f8012-f642-483c-9d46-df489fbd673c Apr 24 13:54:40 devstack sudo[89425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:40 devstack sudo[89423]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:40 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-faecec03-456e-4f96-9c0a-a64d4d3a5286 tempest-SnapshotMetadataTestJSON-314085606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-318508cc-9be8-4030-b0a2-52efdaeff649.ee02bf2a-c13a-4834-9fa5-30d0e24edb9a" returned: 0 in 0.504s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:40 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-faecec03-456e-4f96-9c0a-a64d4d3a5286 tempest-SnapshotMetadataTestJSON-314085606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-318508cc-9be8-4030-b0a2-52efdaeff649.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:40 devstack sudo[89428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-318508cc-9be8-4030-b0a2-52efdaeff649.info Apr 24 13:54:40 devstack sudo[89428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:40 devstack sudo[89425]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:40 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-57dfe336-ce1a-451f-9e2a-1c0da440bbcb tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1f4f8012-f642-483c-9d46-df489fbd673c" returned: 0 in 0.551s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:40 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-57dfe336-ce1a-451f-9e2a-1c0da440bbcb tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1f4f8012-f642-483c-9d46-df489fbd673c {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:40 devstack sudo[89433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1f4f8012-f642-483c-9d46-df489fbd673c Apr 24 13:54:40 devstack sudo[89433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:41 devstack sudo[89428]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-faecec03-456e-4f96-9c0a-a64d4d3a5286 tempest-SnapshotMetadataTestJSON-314085606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-318508cc-9be8-4030-b0a2-52efdaeff649.info" returned: 0 in 0.497s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:41 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-faecec03-456e-4f96-9c0a-a64d4d3a5286 tempest-SnapshotMetadataTestJSON-314085606 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-318508cc-9be8-4030-b0a2-52efdaeff649.info is being set with open permissions: ugo+rw Apr 24 13:54:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-faecec03-456e-4f96-9c0a-a64d4d3a5286 tempest-SnapshotMetadataTestJSON-314085606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-318508cc-9be8-4030-b0a2-52efdaeff649.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:41 devstack sudo[89436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-318508cc-9be8-4030-b0a2-52efdaeff649.info Apr 24 13:54:41 devstack sudo[89436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:41 devstack sudo[89433]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-57dfe336-ce1a-451f-9e2a-1c0da440bbcb tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-1f4f8012-f642-483c-9d46-df489fbd673c" returned: 0 in 0.468s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:41 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-57dfe336-ce1a-451f-9e2a-1c0da440bbcb tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "cinder-quobyte-1f4f8012-f642-483c-9d46-df489fbd673c" released by "delete_volume" :: held 1.060s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:54:41 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-57dfe336-ce1a-451f-9e2a-1c0da440bbcb tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Created reservations ['915b927f-0a39-4e25-abcc-3371091ef73d', '436b2b10-184a-4eed-a58d-ed00cbd51aa5', '0896b741-6708-412b-9699-a1f3f604df83', 'fa3b4158-8134-4f1f-8a97-dd3db2b51b57'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:54:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-57dfe336-ce1a-451f-9e2a-1c0da440bbcb tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:54:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-57dfe336-ce1a-451f-9e2a-1c0da440bbcb tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:54:41 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-57dfe336-ce1a-451f-9e2a-1c0da440bbcb tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:54:41 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-57dfe336-ce1a-451f-9e2a-1c0da440bbcb tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:54:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-57dfe336-ce1a-451f-9e2a-1c0da440bbcb tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:54:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-57dfe336-ce1a-451f-9e2a-1c0da440bbcb tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:41 devstack sudo[89439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:54:41 devstack sudo[89439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:41 devstack sudo[89436]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-faecec03-456e-4f96-9c0a-a64d4d3a5286 tempest-SnapshotMetadataTestJSON-314085606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-318508cc-9be8-4030-b0a2-52efdaeff649.info" returned: 0 in 0.503s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-faecec03-456e-4f96-9c0a-a64d4d3a5286 tempest-SnapshotMetadataTestJSON-314085606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.484s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:54:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-9e47fa71-b3c9-4e8d-8d4f-8416a2455f39 tempest-SnapshotDependencyTests-618444304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.446s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:54:41 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-9e47fa71-b3c9-4e8d-8d4f-8416a2455f39 tempest-SnapshotDependencyTests-618444304 None] Creating offline snapshot 98856edd-ba58-44bf-9610-8f1c0fc8d766 of volume 0dbac441-f3b3-4468-999b-04534bebf48d {{(pid=82046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 13:54:41 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-faecec03-456e-4f96-9c0a-a64d4d3a5286 tempest-SnapshotMetadataTestJSON-314085606 None] Create snapshot completed successfully Apr 24 13:54:41 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[536ef38d-e0ea-4d50-b2fa-c0e4253d8d03]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:54:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-9e47fa71-b3c9-4e8d-8d4f-8416a2455f39 tempest-SnapshotDependencyTests-618444304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:41 devstack sudo[89442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d Apr 24 13:54:41 devstack sudo[89442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:42 devstack sudo[89439]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:42 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-57dfe336-ce1a-451f-9e2a-1c0da440bbcb tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.488s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:42 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-57dfe336-ce1a-451f-9e2a-1c0da440bbcb tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:54:42 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-57dfe336-ce1a-451f-9e2a-1c0da440bbcb tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Deleted volume successfully. Apr 24 13:54:42 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-57dfe336-ce1a-451f-9e2a-1c0da440bbcb tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "cinder-1f4f8012-f642-483c-9d46-df489fbd673c-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:54:42 devstack sudo[89442]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:42 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-9e47fa71-b3c9-4e8d-8d4f-8416a2455f39 tempest-SnapshotDependencyTests-618444304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d" returned: 0 in 0.616s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:42 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-9e47fa71-b3c9-4e8d-8d4f-8416a2455f39 tempest-SnapshotDependencyTests-618444304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d.98856edd-ba58-44bf-9610-8f1c0fc8d766 1G {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:42 devstack sudo[89448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d.98856edd-ba58-44bf-9610-8f1c0fc8d766 1G Apr 24 13:54:42 devstack sudo[89448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:42 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-a9087bd8-bc5f-49d8-a407-f29ac2090c49 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Acquiring lock "cinder-3cebcf94-26f6-44b5-bb08-2b6155bf405a-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:54:42 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-a9087bd8-bc5f-49d8-a407-f29ac2090c49 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "cinder-3cebcf94-26f6-44b5-bb08-2b6155bf405a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:54:42 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-a9087bd8-bc5f-49d8-a407-f29ac2090c49 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Acquiring lock "cinder-quobyte-3cebcf94-26f6-44b5-bb08-2b6155bf405a" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:54:42 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-a9087bd8-bc5f-49d8-a407-f29ac2090c49 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "cinder-quobyte-3cebcf94-26f6-44b5-bb08-2b6155bf405a" acquired by "delete_volume" :: waited 0.016s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:54:42 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[56849af2-d7df-4f57-95f3-faaf56588bb1]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:54:42 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a9087bd8-bc5f-49d8-a407-f29ac2090c49 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-3cebcf94-26f6-44b5-bb08-2b6155bf405a {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:42 devstack sudo[89450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-3cebcf94-26f6-44b5-bb08-2b6155bf405a Apr 24 13:54:42 devstack sudo[89450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:42 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-1692a74e-43d6-460c-be03-5a180208d0c2 tempest-SnapshotMetadataTestJSON-314085606 None] Acquiring lock "cinder-ee02bf2a-c13a-4834-9fa5-30d0e24edb9a-delete_snapshot" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:54:42 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-1692a74e-43d6-460c-be03-5a180208d0c2 tempest-SnapshotMetadataTestJSON-314085606 None] Lock "cinder-ee02bf2a-c13a-4834-9fa5-30d0e24edb9a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:54:42 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-1692a74e-43d6-460c-be03-5a180208d0c2 tempest-SnapshotMetadataTestJSON-314085606 None] Acquiring lock "cinder-quobyte-318508cc-9be8-4030-b0a2-52efdaeff649" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:54:42 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-1692a74e-43d6-460c-be03-5a180208d0c2 tempest-SnapshotMetadataTestJSON-314085606 None] Lock "cinder-quobyte-318508cc-9be8-4030-b0a2-52efdaeff649" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:54:42 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-1692a74e-43d6-460c-be03-5a180208d0c2 tempest-SnapshotMetadataTestJSON-314085606 None] Acquiring lock "cinder-quobyte-ee02bf2a-c13a-4834-9fa5-30d0e24edb9a" by "_delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:54:42 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-1692a74e-43d6-460c-be03-5a180208d0c2 tempest-SnapshotMetadataTestJSON-314085606 None] Lock "cinder-quobyte-ee02bf2a-c13a-4834-9fa5-30d0e24edb9a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:54:42 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-1692a74e-43d6-460c-be03-5a180208d0c2 tempest-SnapshotMetadataTestJSON-314085606 None] Deleting offline snapshot ee02bf2a-c13a-4834-9fa5-30d0e24edb9a of volume 318508cc-9be8-4030-b0a2-52efdaeff649 {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 13:54:42 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-1692a74e-43d6-460c-be03-5a180208d0c2 tempest-SnapshotMetadataTestJSON-314085606 None] snapshot_file for this snap is: volume-318508cc-9be8-4030-b0a2-52efdaeff649.ee02bf2a-c13a-4834-9fa5-30d0e24edb9a {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 13:54:42 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b81886-2c7b-4967-979b-8ab2fd4895ae]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:54:42 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-1692a74e-43d6-460c-be03-5a180208d0c2 tempest-SnapshotMetadataTestJSON-314085606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-318508cc-9be8-4030-b0a2-52efdaeff649.ee02bf2a-c13a-4834-9fa5-30d0e24edb9a {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:42 devstack sudo[89454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-318508cc-9be8-4030-b0a2-52efdaeff649.ee02bf2a-c13a-4834-9fa5-30d0e24edb9a Apr 24 13:54:42 devstack sudo[89454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:43 devstack sudo[89448]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-9e47fa71-b3c9-4e8d-8d4f-8416a2455f39 tempest-SnapshotDependencyTests-618444304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d.98856edd-ba58-44bf-9610-8f1c0fc8d766 1G" returned: 0 in 0.755s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-9e47fa71-b3c9-4e8d-8d4f-8416a2455f39 tempest-SnapshotDependencyTests-618444304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0dbac441-f3b3-4468-999b-04534bebf48d -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d.98856edd-ba58-44bf-9610-8f1c0fc8d766 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:43 devstack sudo[89460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0dbac441-f3b3-4468-999b-04534bebf48d -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d.98856edd-ba58-44bf-9610-8f1c0fc8d766 Apr 24 13:54:43 devstack sudo[89460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:43 devstack sudo[89450]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a9087bd8-bc5f-49d8-a407-f29ac2090c49 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-3cebcf94-26f6-44b5-bb08-2b6155bf405a" returned: 0 in 0.597s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a9087bd8-bc5f-49d8-a407-f29ac2090c49 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-3cebcf94-26f6-44b5-bb08-2b6155bf405a {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:43 devstack sudo[89462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-3cebcf94-26f6-44b5-bb08-2b6155bf405a Apr 24 13:54:43 devstack sudo[89462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:43 devstack sudo[89454]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-1692a74e-43d6-460c-be03-5a180208d0c2 tempest-SnapshotMetadataTestJSON-314085606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-318508cc-9be8-4030-b0a2-52efdaeff649.ee02bf2a-c13a-4834-9fa5-30d0e24edb9a" returned: 0 in 0.589s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:43 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-1692a74e-43d6-460c-be03-5a180208d0c2 tempest-SnapshotMetadataTestJSON-314085606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-318508cc-9be8-4030-b0a2-52efdaeff649(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:54:43 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d32847-c5d4-47e4-8730-ba265aa49fe1]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:54:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-1692a74e-43d6-460c-be03-5a180208d0c2 tempest-SnapshotMetadataTestJSON-314085606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-318508cc-9be8-4030-b0a2-52efdaeff649 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:43 devstack sudo[89467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-318508cc-9be8-4030-b0a2-52efdaeff649 Apr 24 13:54:43 devstack sudo[89467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:43 devstack sudo[89460]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-9e47fa71-b3c9-4e8d-8d4f-8416a2455f39 tempest-SnapshotDependencyTests-618444304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0dbac441-f3b3-4468-999b-04534bebf48d -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d.98856edd-ba58-44bf-9610-8f1c0fc8d766" returned: 0 in 0.517s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:43 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-9e47fa71-b3c9-4e8d-8d4f-8416a2455f39 tempest-SnapshotDependencyTests-618444304 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d.98856edd-ba58-44bf-9610-8f1c0fc8d766 is being set with open permissions: ugo+rw Apr 24 13:54:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-9e47fa71-b3c9-4e8d-8d4f-8416a2455f39 tempest-SnapshotDependencyTests-618444304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d.98856edd-ba58-44bf-9610-8f1c0fc8d766 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:43 devstack sudo[89472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d.98856edd-ba58-44bf-9610-8f1c0fc8d766 Apr 24 13:54:43 devstack sudo[89472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:43 devstack sudo[89462]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a9087bd8-bc5f-49d8-a407-f29ac2090c49 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-3cebcf94-26f6-44b5-bb08-2b6155bf405a" returned: 0 in 0.563s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:43 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-a9087bd8-bc5f-49d8-a407-f29ac2090c49 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "cinder-quobyte-3cebcf94-26f6-44b5-bb08-2b6155bf405a" released by "delete_volume" :: held 1.207s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:54:43 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-a9087bd8-bc5f-49d8-a407-f29ac2090c49 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Created reservations ['bc2e4afb-d004-4283-99d8-165592788c20', 'f2e8a68e-ccc4-4eb5-8740-a3ba1e8fee98', 'cfc943e0-9f15-4268-b5df-35c86c3169b9', '8783307d-0182-40fb-a1b3-7a7b3bea5cae'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:54:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a9087bd8-bc5f-49d8-a407-f29ac2090c49 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:54:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a9087bd8-bc5f-49d8-a407-f29ac2090c49 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:54:43 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a9087bd8-bc5f-49d8-a407-f29ac2090c49 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:54:43 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a9087bd8-bc5f-49d8-a407-f29ac2090c49 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:54:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a9087bd8-bc5f-49d8-a407-f29ac2090c49 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:54:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a9087bd8-bc5f-49d8-a407-f29ac2090c49 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:43 devstack sudo[89475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:54:43 devstack sudo[89475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:44 devstack sudo[89467]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-1692a74e-43d6-460c-be03-5a180208d0c2 tempest-SnapshotMetadataTestJSON-314085606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-318508cc-9be8-4030-b0a2-52efdaeff649" returned: 0 in 0.584s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-1692a74e-43d6-460c-be03-5a180208d0c2 tempest-SnapshotMetadataTestJSON-314085606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-318508cc-9be8-4030-b0a2-52efdaeff649.ee02bf2a-c13a-4834-9fa5-30d0e24edb9a {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:44 devstack sudo[89480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-318508cc-9be8-4030-b0a2-52efdaeff649.ee02bf2a-c13a-4834-9fa5-30d0e24edb9a Apr 24 13:54:44 devstack sudo[89480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:44 devstack sudo[89472]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-9e47fa71-b3c9-4e8d-8d4f-8416a2455f39 tempest-SnapshotDependencyTests-618444304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d.98856edd-ba58-44bf-9610-8f1c0fc8d766" returned: 0 in 0.537s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-9e47fa71-b3c9-4e8d-8d4f-8416a2455f39 tempest-SnapshotDependencyTests-618444304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:44 devstack sudo[89483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d.info Apr 24 13:54:44 devstack sudo[89483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:44 devstack sudo[89475]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a9087bd8-bc5f-49d8-a407-f29ac2090c49 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.543s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:44 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-a9087bd8-bc5f-49d8-a407-f29ac2090c49 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:54:44 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-a9087bd8-bc5f-49d8-a407-f29ac2090c49 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Deleted volume successfully. Apr 24 13:54:44 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-a9087bd8-bc5f-49d8-a407-f29ac2090c49 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "cinder-3cebcf94-26f6-44b5-bb08-2b6155bf405a-delete_volume" released by "delete_volume" :: held 1.970s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:54:44 devstack sudo[89480]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-1692a74e-43d6-460c-be03-5a180208d0c2 tempest-SnapshotMetadataTestJSON-314085606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-318508cc-9be8-4030-b0a2-52efdaeff649.ee02bf2a-c13a-4834-9fa5-30d0e24edb9a" returned: 0 in 0.619s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-1692a74e-43d6-460c-be03-5a180208d0c2 tempest-SnapshotMetadataTestJSON-314085606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-318508cc-9be8-4030-b0a2-52efdaeff649.ee02bf2a-c13a-4834-9fa5-30d0e24edb9a {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:44 devstack sudo[89489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-318508cc-9be8-4030-b0a2-52efdaeff649.ee02bf2a-c13a-4834-9fa5-30d0e24edb9a Apr 24 13:54:44 devstack sudo[89489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:44 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-a9dbd13f-a857-4e9c-9c45-e499f63f8d05 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Acquiring lock "cinder-69dc6907-843d-467f-bfed-9992a03f3187-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:54:44 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-a9dbd13f-a857-4e9c-9c45-e499f63f8d05 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "cinder-69dc6907-843d-467f-bfed-9992a03f3187-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:54:44 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-a9dbd13f-a857-4e9c-9c45-e499f63f8d05 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Acquiring lock "cinder-quobyte-69dc6907-843d-467f-bfed-9992a03f3187" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:54:44 devstack sudo[89483]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:44 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-a9dbd13f-a857-4e9c-9c45-e499f63f8d05 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "cinder-quobyte-69dc6907-843d-467f-bfed-9992a03f3187" acquired by "delete_volume" :: waited 0.017s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:54:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-9e47fa71-b3c9-4e8d-8d4f-8416a2455f39 tempest-SnapshotDependencyTests-618444304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d.info" returned: 0 in 0.574s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:44 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-9e47fa71-b3c9-4e8d-8d4f-8416a2455f39 tempest-SnapshotDependencyTests-618444304 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d.info is being set with open permissions: ugo+rw Apr 24 13:54:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-9e47fa71-b3c9-4e8d-8d4f-8416a2455f39 tempest-SnapshotDependencyTests-618444304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:44 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3fbc0d-3452-47ca-909b-73decafa66a9]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:54:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a9dbd13f-a857-4e9c-9c45-e499f63f8d05 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-69dc6907-843d-467f-bfed-9992a03f3187 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:44 devstack sudo[89492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d.info Apr 24 13:54:44 devstack sudo[89492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:44 devstack sudo[89493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-69dc6907-843d-467f-bfed-9992a03f3187 Apr 24 13:54:44 devstack sudo[89493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:45 devstack sudo[89489]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-1692a74e-43d6-460c-be03-5a180208d0c2 tempest-SnapshotMetadataTestJSON-314085606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-318508cc-9be8-4030-b0a2-52efdaeff649.ee02bf2a-c13a-4834-9fa5-30d0e24edb9a" returned: 0 in 0.542s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:45 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-1692a74e-43d6-460c-be03-5a180208d0c2 tempest-SnapshotMetadataTestJSON-314085606 None] Lock "cinder-quobyte-ee02bf2a-c13a-4834-9fa5-30d0e24edb9a" released by "_delete_snapshot" :: held 2.451s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:54:45 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-1692a74e-43d6-460c-be03-5a180208d0c2 tempest-SnapshotMetadataTestJSON-314085606 None] Lock "cinder-quobyte-318508cc-9be8-4030-b0a2-52efdaeff649" released by "delete_snapshot" :: held 2.481s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:54:45 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-1692a74e-43d6-460c-be03-5a180208d0c2 tempest-SnapshotMetadataTestJSON-314085606 None] Created reservations ['8493fbea-907f-4f84-93fe-12dda69e4c20', 'ec8fef8a-2c04-4ed1-b32f-afd0d87fa197', '065b8077-1388-45eb-b56d-af7916f79bd6', 'f3f90041-a6fe-4c40-8100-1940e893ad41'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:54:45 devstack sudo[89492]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-9e47fa71-b3c9-4e8d-8d4f-8416a2455f39 tempest-SnapshotDependencyTests-618444304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d.info" returned: 0 in 0.545s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-9e47fa71-b3c9-4e8d-8d4f-8416a2455f39 tempest-SnapshotDependencyTests-618444304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.732s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:54:45 devstack sudo[89493]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:45 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-1692a74e-43d6-460c-be03-5a180208d0c2 tempest-SnapshotMetadataTestJSON-314085606 None] Delete snapshot completed successfully. Apr 24 13:54:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a9dbd13f-a857-4e9c-9c45-e499f63f8d05 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-69dc6907-843d-467f-bfed-9992a03f3187" returned: 0 in 0.580s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a9dbd13f-a857-4e9c-9c45-e499f63f8d05 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-69dc6907-843d-467f-bfed-9992a03f3187 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:45 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-1692a74e-43d6-460c-be03-5a180208d0c2 tempest-SnapshotMetadataTestJSON-314085606 None] Lock "cinder-ee02bf2a-c13a-4834-9fa5-30d0e24edb9a-delete_snapshot" released by "delete_snapshot" :: held 2.714s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:54:45 devstack sudo[89501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-69dc6907-843d-467f-bfed-9992a03f3187 Apr 24 13:54:45 devstack sudo[89501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:45 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-9e47fa71-b3c9-4e8d-8d4f-8416a2455f39 tempest-SnapshotDependencyTests-618444304 None] Create snapshot completed successfully Apr 24 13:54:45 devstack sudo[89501]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a9dbd13f-a857-4e9c-9c45-e499f63f8d05 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-69dc6907-843d-467f-bfed-9992a03f3187" returned: 0 in 0.495s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:45 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-a9dbd13f-a857-4e9c-9c45-e499f63f8d05 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "cinder-quobyte-69dc6907-843d-467f-bfed-9992a03f3187" released by "delete_volume" :: held 1.137s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:54:46 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-a9dbd13f-a857-4e9c-9c45-e499f63f8d05 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Created reservations ['16139e0f-2d83-4a61-8bb3-2eea194b413d', '0ef93296-dc40-4e9b-a9c4-c131d12a2442', '13db43ca-ae65-4885-9749-0037dfad2ca3', '4a75be42-80eb-4297-bbb1-207079babe1b'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:54:47 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d6bdb860-7857-448f-b06e-50cc968f751e tempest-SnapshotMetadataTestJSON-314085606 None] Acquiring lock "cinder-318508cc-9be8-4030-b0a2-52efdaeff649-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:54:47 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d6bdb860-7857-448f-b06e-50cc968f751e tempest-SnapshotMetadataTestJSON-314085606 None] Lock "cinder-318508cc-9be8-4030-b0a2-52efdaeff649-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:54:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a9dbd13f-a857-4e9c-9c45-e499f63f8d05 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:54:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a9dbd13f-a857-4e9c-9c45-e499f63f8d05 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:54:48 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a9dbd13f-a857-4e9c-9c45-e499f63f8d05 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:54:48 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a9dbd13f-a857-4e9c-9c45-e499f63f8d05 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:54:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a9dbd13f-a857-4e9c-9c45-e499f63f8d05 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:54:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a9dbd13f-a857-4e9c-9c45-e499f63f8d05 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:48 devstack sudo[89505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:54:48 devstack sudo[89505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:49 devstack sudo[89505]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a9dbd13f-a857-4e9c-9c45-e499f63f8d05 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.450s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:49 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-a9dbd13f-a857-4e9c-9c45-e499f63f8d05 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:54:49 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-a9dbd13f-a857-4e9c-9c45-e499f63f8d05 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Deleted volume successfully. Apr 24 13:54:49 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d6bdb860-7857-448f-b06e-50cc968f751e tempest-SnapshotMetadataTestJSON-314085606 None] Acquiring lock "cinder-quobyte-318508cc-9be8-4030-b0a2-52efdaeff649" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:54:49 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-a9dbd13f-a857-4e9c-9c45-e499f63f8d05 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "cinder-69dc6907-843d-467f-bfed-9992a03f3187-delete_volume" released by "delete_volume" :: held 4.878s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:54:49 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-5c3a47d6-73cb-4ca8-80db-fcd1d582cef7 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Acquiring lock "cinder-44bec76e-5f00-4998-af0d-847657adf581-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:54:49 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d6bdb860-7857-448f-b06e-50cc968f751e tempest-SnapshotMetadataTestJSON-314085606 None] Lock "cinder-quobyte-318508cc-9be8-4030-b0a2-52efdaeff649" acquired by "delete_volume" :: waited 0.035s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:54:49 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-5c3a47d6-73cb-4ca8-80db-fcd1d582cef7 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "cinder-44bec76e-5f00-4998-af0d-847657adf581-delete_volume" acquired by "delete_volume" :: waited 0.124s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:54:49 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[313dacf6-807b-4915-8aa2-6b6408dd44a9]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:54:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d6bdb860-7857-448f-b06e-50cc968f751e tempest-SnapshotMetadataTestJSON-314085606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-318508cc-9be8-4030-b0a2-52efdaeff649 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:49 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:54:49 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-5c3a47d6-73cb-4ca8-80db-fcd1d582cef7 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Acquiring lock "cinder-quobyte-44bec76e-5f00-4998-af0d-847657adf581" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:54:49 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] Flow 'volume_create_manager' (4beb9a61-b5a4-4fb0-8b16-e0d67b8a21a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:54:49 devstack sudo[89514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-318508cc-9be8-4030-b0a2-52efdaeff649 Apr 24 13:54:49 devstack sudo[89514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:49 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a57642d6-87e9-4680-ac5a-ea7ff447fe71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:49 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-5c3a47d6-73cb-4ca8-80db-fcd1d582cef7 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "cinder-quobyte-44bec76e-5f00-4998-af0d-847657adf581" acquired by "delete_volume" :: waited 0.040s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:54:49 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a57642d6-87e9-4680-ac5a-ea7ff447fe71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:54:47Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44374df2-936d-4fbb-a173-52d549b0ddd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2281cda3285410ab129619c0666a11d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=98856edd-ba58-44bf-9610-8f1c0fc8d766,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:54:50Z,use_quota=True,user_id='6efe66b86392472c9fd87a5cbd9ed5ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:49 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fd5418e-4d75-49ef-b2e2-79519b0d7341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:49 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fd5418e-4d75-49ef-b2e2-79519b0d7341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:49 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cd5df11-1e83-43fc-bf45-8e57d804e303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:49 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cd5df11-1e83-43fc-bf45-8e57d804e303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '44374df2-936d-4fbb-a173-52d549b0ddd7', 'volume_name': 'volume-44374df2-936d-4fbb-a173-52d549b0ddd7', 'volume_size': 1, 'snapshot_id': '98856edd-ba58-44bf-9610-8f1c0fc8d766'}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:49 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3348afc2-726c-4698-9f53-b5899e154033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:50 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3348afc2-726c-4698-9f53-b5899e154033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:50 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfbc6c05-e866-4773-9862-f38c589d9010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:50 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] Volume 44374df2-936d-4fbb-a173-52d549b0ddd7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-44374df2-936d-4fbb-a173-52d549b0ddd7', 'volume_size': 1, 'snapshot_id': '98856edd-ba58-44bf-9610-8f1c0fc8d766'} Apr 24 13:54:50 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd1c2c4-b22d-4269-b4e5-1f3b72d70c8c]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:54:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5c3a47d6-73cb-4ca8-80db-fcd1d582cef7 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44bec76e-5f00-4998-af0d-847657adf581 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:54:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:54:50 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] Acquiring lock "cinder-quobyte-98856edd-ba58-44bf-9610-8f1c0fc8d766-44374df2-936d-4fbb-a173-52d549b0ddd7" by "_create_volume_from_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:54:50 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] Lock "cinder-quobyte-98856edd-ba58-44bf-9610-8f1c0fc8d766-44374df2-936d-4fbb-a173-52d549b0ddd7" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:54:50 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] Creating volume 44374df2-936d-4fbb-a173-52d549b0ddd7 from snapshot 98856edd-ba58-44bf-9610-8f1c0fc8d766 {{(pid=82046) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 13:54:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:54:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:54:50 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:54:50 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:54:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:54:50 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:54:50 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] Acquiring lock "cinder-quobyte-44374df2-936d-4fbb-a173-52d549b0ddd7" by "_copy_volume_from_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:54:50 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] Lock "cinder-quobyte-44374df2-936d-4fbb-a173-52d549b0ddd7" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:54:50 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] snapshot: 98856edd-ba58-44bf-9610-8f1c0fc8d766, volume: 44374df2-936d-4fbb-a173-52d549b0ddd7, {{(pid=82046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 13:54:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:54:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:54:50 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:54:50 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:54:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:54:50 devstack sudo[89516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44bec76e-5f00-4998-af0d-847657adf581 Apr 24 13:54:50 devstack sudo[89516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:50 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[958b75cf-0eb3-4f9f-ae52-42ace7aae332]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:54:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d.98856edd-ba58-44bf-9610-8f1c0fc8d766 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:50 devstack sudo[89518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d.98856edd-ba58-44bf-9610-8f1c0fc8d766 Apr 24 13:54:50 devstack sudo[89518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:50 devstack sudo[89514]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d6bdb860-7857-448f-b06e-50cc968f751e tempest-SnapshotMetadataTestJSON-314085606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-318508cc-9be8-4030-b0a2-52efdaeff649" returned: 0 in 0.571s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d6bdb860-7857-448f-b06e-50cc968f751e tempest-SnapshotMetadataTestJSON-314085606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-318508cc-9be8-4030-b0a2-52efdaeff649 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:50 devstack sudo[89523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-318508cc-9be8-4030-b0a2-52efdaeff649 Apr 24 13:54:50 devstack sudo[89523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:50 devstack sudo[89516]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5c3a47d6-73cb-4ca8-80db-fcd1d582cef7 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44bec76e-5f00-4998-af0d-847657adf581" returned: 0 in 0.607s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5c3a47d6-73cb-4ca8-80db-fcd1d582cef7 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44bec76e-5f00-4998-af0d-847657adf581 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:50 devstack sudo[89531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44bec76e-5f00-4998-af0d-847657adf581 Apr 24 13:54:50 devstack sudo[89531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:50 devstack sudo[89518]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d.98856edd-ba58-44bf-9610-8f1c0fc8d766" returned: 0 in 0.591s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:50 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0dbac441-f3b3-4468-999b-04534bebf48d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:54:50 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d {{(pid=82046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 13:54:50 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] Creating direct copy from snapshot {{(pid=82046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 13:54:50 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc2fd2f-63ba-431e-90a2-119de37cf05a]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:54:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:50 devstack sudo[89533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d Apr 24 13:54:50 devstack sudo[89533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:50 devstack sudo[89523]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d6bdb860-7857-448f-b06e-50cc968f751e tempest-SnapshotMetadataTestJSON-314085606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-318508cc-9be8-4030-b0a2-52efdaeff649" returned: 0 in 0.537s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:50 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d6bdb860-7857-448f-b06e-50cc968f751e tempest-SnapshotMetadataTestJSON-314085606 None] Lock "cinder-quobyte-318508cc-9be8-4030-b0a2-52efdaeff649" released by "delete_volume" :: held 1.322s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:54:51 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-d6bdb860-7857-448f-b06e-50cc968f751e tempest-SnapshotMetadataTestJSON-314085606 None] Created reservations ['27e3c7a3-70fb-499e-8aa1-bc0d8650b70e', '99253ec6-01bd-4e41-9018-82df5fcb9192', 'f89ca897-d743-44a3-a139-0162a5702690', '76daafac-4f15-478a-8db4-370637a842c4'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:54:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d6bdb860-7857-448f-b06e-50cc968f751e tempest-SnapshotMetadataTestJSON-314085606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:54:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d6bdb860-7857-448f-b06e-50cc968f751e tempest-SnapshotMetadataTestJSON-314085606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:54:51 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-d6bdb860-7857-448f-b06e-50cc968f751e tempest-SnapshotMetadataTestJSON-314085606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:54:51 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-d6bdb860-7857-448f-b06e-50cc968f751e tempest-SnapshotMetadataTestJSON-314085606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:54:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d6bdb860-7857-448f-b06e-50cc968f751e tempest-SnapshotMetadataTestJSON-314085606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:54:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d6bdb860-7857-448f-b06e-50cc968f751e tempest-SnapshotMetadataTestJSON-314085606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:51 devstack sudo[89537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:54:51 devstack sudo[89537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:51 devstack sudo[89531]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5c3a47d6-73cb-4ca8-80db-fcd1d582cef7 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44bec76e-5f00-4998-af0d-847657adf581" returned: 0 in 0.597s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:51 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-5c3a47d6-73cb-4ca8-80db-fcd1d582cef7 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "cinder-quobyte-44bec76e-5f00-4998-af0d-847657adf581" released by "delete_volume" :: held 1.276s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:54:51 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-5c3a47d6-73cb-4ca8-80db-fcd1d582cef7 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Created reservations ['a3fe1ef9-9331-4093-9e33-7519bce70e31', '7973ee25-a72f-4a44-ad5b-9a98b78d81d5', 'c9266297-fe58-426a-946e-c4ecf645339c', 'd211d5b0-5ece-4020-b7fa-685514d21562'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:54:51 devstack sudo[89533]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d" returned: 0 in 0.630s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:51 devstack cinder-volume[82046]: DEBUG cinder.utils [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] Path /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44374df2-936d-4fbb-a173-52d549b0ddd7 not found in is_blk_device check {{(pid=82046) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 13:54:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44374df2-936d-4fbb-a173-52d549b0ddd7 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5c3a47d6-73cb-4ca8-80db-fcd1d582cef7 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:54:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5c3a47d6-73cb-4ca8-80db-fcd1d582cef7 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:54:51 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-5c3a47d6-73cb-4ca8-80db-fcd1d582cef7 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:54:51 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-5c3a47d6-73cb-4ca8-80db-fcd1d582cef7 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:54:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5c3a47d6-73cb-4ca8-80db-fcd1d582cef7 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:54:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5c3a47d6-73cb-4ca8-80db-fcd1d582cef7 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:51 devstack sudo[89542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44374df2-936d-4fbb-a173-52d549b0ddd7 Apr 24 13:54:51 devstack sudo[89542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:51 devstack sudo[89544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:54:51 devstack sudo[89544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:51 devstack sudo[89537]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d6bdb860-7857-448f-b06e-50cc968f751e tempest-SnapshotMetadataTestJSON-314085606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.563s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:51 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-d6bdb860-7857-448f-b06e-50cc968f751e tempest-SnapshotMetadataTestJSON-314085606 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:54:51 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-d6bdb860-7857-448f-b06e-50cc968f751e tempest-SnapshotMetadataTestJSON-314085606 None] Deleted volume successfully. Apr 24 13:54:51 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d6bdb860-7857-448f-b06e-50cc968f751e tempest-SnapshotMetadataTestJSON-314085606 None] Lock "cinder-318508cc-9be8-4030-b0a2-52efdaeff649-delete_volume" released by "delete_volume" :: held 4.674s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:54:51 devstack sudo[89544]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5c3a47d6-73cb-4ca8-80db-fcd1d582cef7 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.566s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:51 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-5c3a47d6-73cb-4ca8-80db-fcd1d582cef7 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:54:51 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-5c3a47d6-73cb-4ca8-80db-fcd1d582cef7 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Deleted volume successfully. Apr 24 13:54:52 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-5c3a47d6-73cb-4ca8-80db-fcd1d582cef7 tempest-CreateVolumesFromSourceVolumeTest-1389780751 None] Lock "cinder-44bec76e-5f00-4998-af0d-847657adf581-delete_volume" released by "delete_volume" :: held 2.244s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:54:57 devstack sudo[89542]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:57 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44374df2-936d-4fbb-a173-52d549b0ddd7" returned: 0 in 6.294s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:57 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ba7d5a-5f42-4dad-b5cf-fe49d60b5b91]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:54:57 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:57 devstack sudo[89559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d Apr 24 13:54:57 devstack sudo[89559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:58 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-de56844f-21dc-4245-83b9-6bd2e49a13fa tempest-VolumesMetadataTest-1554473363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:54:58 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-de56844f-21dc-4245-83b9-6bd2e49a13fa tempest-VolumesMetadataTest-1554473363 None] Flow 'volume_create_manager' (b6c23dec-d259-4f1a-8c20-49c3495a2f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:54:58 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-de56844f-21dc-4245-83b9-6bd2e49a13fa tempest-VolumesMetadataTest-1554473363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad996b67-eeff-4946-8274-dedf29e91b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:58 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-de56844f-21dc-4245-83b9-6bd2e49a13fa tempest-VolumesMetadataTest-1554473363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad996b67-eeff-4946-8274-dedf29e91b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-257020053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3373479-ee32-4210-ac4b-d141bc030d05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='259181baa5ad45ec98c5dc66a6abb748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:54:58Z,use_quota=True,user_id='df23f420c3fc4f1c91db9059b0d8529c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:58 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-de56844f-21dc-4245-83b9-6bd2e49a13fa tempest-VolumesMetadataTest-1554473363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71fb07ec-a7d9-445b-a6b2-a9964df3638e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:58 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-de56844f-21dc-4245-83b9-6bd2e49a13fa tempest-VolumesMetadataTest-1554473363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71fb07ec-a7d9-445b-a6b2-a9964df3638e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:58 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-de56844f-21dc-4245-83b9-6bd2e49a13fa tempest-VolumesMetadataTest-1554473363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5428dbf1-f306-4291-8cd9-1f7e8c716a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:58 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-de56844f-21dc-4245-83b9-6bd2e49a13fa tempest-VolumesMetadataTest-1554473363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5428dbf1-f306-4291-8cd9-1f7e8c716a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3373479-ee32-4210-ac4b-d141bc030d05', 'volume_name': 'volume-e3373479-ee32-4210-ac4b-d141bc030d05', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:58 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-de56844f-21dc-4245-83b9-6bd2e49a13fa tempest-VolumesMetadataTest-1554473363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6f09c6f-e7f7-4b96-8174-7096d8ac52a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:58 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-de56844f-21dc-4245-83b9-6bd2e49a13fa tempest-VolumesMetadataTest-1554473363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6f09c6f-e7f7-4b96-8174-7096d8ac52a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:58 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-de56844f-21dc-4245-83b9-6bd2e49a13fa tempest-VolumesMetadataTest-1554473363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09f3d8a8-d1d6-46d2-aa3b-aa5c38e0d04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:58 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-de56844f-21dc-4245-83b9-6bd2e49a13fa tempest-VolumesMetadataTest-1554473363 None] Volume e3373479-ee32-4210-ac4b-d141bc030d05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3373479-ee32-4210-ac4b-d141bc030d05', 'volume_size': 1} Apr 24 13:54:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de56844f-21dc-4245-83b9-6bd2e49a13fa tempest-VolumesMetadataTest-1554473363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:54:58 devstack sudo[89559]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d" returned: 0 in 0.816s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:58 devstack cinder-volume[82046]: DEBUG cinder.image.image_utils [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] Image conversion details: src /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d, size 1024.00 MB, duration 6.29 sec, destination /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44374df2-936d-4fbb-a173-52d549b0ddd7 {{(pid=82046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 13:54:58 devstack cinder-volume[82046]: INFO cinder.image.image_utils [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] Converted 1024.00 MB image at 162.67 MB/s Apr 24 13:54:58 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44374df2-936d-4fbb-a173-52d549b0ddd7 is being set with open permissions: ugo+rw Apr 24 13:54:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44374df2-936d-4fbb-a173-52d549b0ddd7 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:58 devstack sudo[89564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44374df2-936d-4fbb-a173-52d549b0ddd7 Apr 24 13:54:58 devstack sudo[89564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:58 devstack sudo[89564]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44374df2-936d-4fbb-a173-52d549b0ddd7" returned: 0 in 0.454s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:58 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] Lock "cinder-quobyte-44374df2-936d-4fbb-a173-52d549b0ddd7" released by "_copy_volume_from_snapshot" :: held 8.898s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:54:58 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] Lock "cinder-quobyte-98856edd-ba58-44bf-9610-8f1c0fc8d766-44374df2-936d-4fbb-a173-52d549b0ddd7" released by "_create_volume_from_snapshot" :: held 8.931s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:54:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.946s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:54:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de56844f-21dc-4245-83b9-6bd2e49a13fa tempest-VolumesMetadataTest-1554473363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.513s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:54:58 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-de56844f-21dc-4245-83b9-6bd2e49a13fa tempest-VolumesMetadataTest-1554473363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-257020053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3373479-ee32-4210-ac4b-d141bc030d05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='259181baa5ad45ec98c5dc66a6abb748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:54:58Z,use_quota=True,user_id='df23f420c3fc4f1c91db9059b0d8529c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:54:58 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-de56844f-21dc-4245-83b9-6bd2e49a13fa tempest-VolumesMetadataTest-1554473363 None] Creating volume e3373479-ee32-4210-ac4b-d141bc030d05 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:54:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de56844f-21dc-4245-83b9-6bd2e49a13fa tempest-VolumesMetadataTest-1554473363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:54:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de56844f-21dc-4245-83b9-6bd2e49a13fa tempest-VolumesMetadataTest-1554473363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:54:58 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-de56844f-21dc-4245-83b9-6bd2e49a13fa tempest-VolumesMetadataTest-1554473363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:54:58 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-de56844f-21dc-4245-83b9-6bd2e49a13fa tempest-VolumesMetadataTest-1554473363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:54:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de56844f-21dc-4245-83b9-6bd2e49a13fa tempest-VolumesMetadataTest-1554473363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:54:58 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-de56844f-21dc-4245-83b9-6bd2e49a13fa tempest-VolumesMetadataTest-1554473363 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:54:58 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-de56844f-21dc-4245-83b9-6bd2e49a13fa tempest-VolumesMetadataTest-1554473363 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:54:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-de56844f-21dc-4245-83b9-6bd2e49a13fa tempest-VolumesMetadataTest-1554473363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e3373479-ee32-4210-ac4b-d141bc030d05 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:59 devstack sudo[89567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e3373479-ee32-4210-ac4b-d141bc030d05 1073741824 Apr 24 13:54:59 devstack sudo[89567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfbc6c05-e866-4773-9862-f38c589d9010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44374df2-936d-4fbb-a173-52d549b0ddd7', 'volume_size': 1, 'snapshot_id': '98856edd-ba58-44bf-9610-8f1c0fc8d766'}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdb0765b-87dd-4c29-9ded-e9dc90be51d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:54:59 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] Volume volume-44374df2-936d-4fbb-a173-52d549b0ddd7 (44374df2-936d-4fbb-a173-52d549b0ddd7): created successfully Apr 24 13:54:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdb0765b-87dd-4c29-9ded-e9dc90be51d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:54:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] Flow 'volume_create_manager' (4beb9a61-b5a4-4fb0-8b16-e0d67b8a21a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:54:59 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-2062a69e-d95a-48d0-abd1-82020feff0d6 tempest-SnapshotDependencyTests-618444304 None] Created volume successfully. Apr 24 13:54:59 devstack sudo[89567]: pam_unix(sudo:session): session closed for user root Apr 24 13:54:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-de56844f-21dc-4245-83b9-6bd2e49a13fa tempest-VolumesMetadataTest-1554473363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e3373479-ee32-4210-ac4b-d141bc030d05 1073741824" returned: 0 in 0.669s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:54:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-de56844f-21dc-4245-83b9-6bd2e49a13fa tempest-VolumesMetadataTest-1554473363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e3373479-ee32-4210-ac4b-d141bc030d05 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:54:59 devstack sudo[89572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e3373479-ee32-4210-ac4b-d141bc030d05 Apr 24 13:54:59 devstack sudo[89572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:54:59 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-bd0e62bb-344d-4ef7-9f14-65dce5c8927f tempest-SnapshotDependencyTests-618444304 None] Acquiring lock "cinder-98856edd-ba58-44bf-9610-8f1c0fc8d766-delete_snapshot" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:54:59 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-bd0e62bb-344d-4ef7-9f14-65dce5c8927f tempest-SnapshotDependencyTests-618444304 None] Lock "cinder-98856edd-ba58-44bf-9610-8f1c0fc8d766-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:54:59 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-bd0e62bb-344d-4ef7-9f14-65dce5c8927f tempest-SnapshotDependencyTests-618444304 None] Acquiring lock "cinder-quobyte-0dbac441-f3b3-4468-999b-04534bebf48d" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:54:59 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-bd0e62bb-344d-4ef7-9f14-65dce5c8927f tempest-SnapshotDependencyTests-618444304 None] Lock "cinder-quobyte-0dbac441-f3b3-4468-999b-04534bebf48d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:54:59 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-bd0e62bb-344d-4ef7-9f14-65dce5c8927f tempest-SnapshotDependencyTests-618444304 None] Acquiring lock "cinder-quobyte-98856edd-ba58-44bf-9610-8f1c0fc8d766" by "_delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:54:59 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-bd0e62bb-344d-4ef7-9f14-65dce5c8927f tempest-SnapshotDependencyTests-618444304 None] Lock "cinder-quobyte-98856edd-ba58-44bf-9610-8f1c0fc8d766" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:54:59 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-bd0e62bb-344d-4ef7-9f14-65dce5c8927f tempest-SnapshotDependencyTests-618444304 None] Deleting offline snapshot 98856edd-ba58-44bf-9610-8f1c0fc8d766 of volume 0dbac441-f3b3-4468-999b-04534bebf48d {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 13:54:59 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-bd0e62bb-344d-4ef7-9f14-65dce5c8927f tempest-SnapshotDependencyTests-618444304 None] snapshot_file for this snap is: volume-0dbac441-f3b3-4468-999b-04534bebf48d.98856edd-ba58-44bf-9610-8f1c0fc8d766 {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 13:54:59 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a610e4-fb76-4b9f-af09-aa31cb6cd3c1]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:54:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bd0e62bb-344d-4ef7-9f14-65dce5c8927f tempest-SnapshotDependencyTests-618444304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d.98856edd-ba58-44bf-9610-8f1c0fc8d766 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:00 devstack sudo[89574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d.98856edd-ba58-44bf-9610-8f1c0fc8d766 Apr 24 13:55:00 devstack sudo[89574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:00 devstack sudo[89572]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:00 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-de56844f-21dc-4245-83b9-6bd2e49a13fa tempest-VolumesMetadataTest-1554473363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e3373479-ee32-4210-ac4b-d141bc030d05" returned: 0 in 0.435s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:00 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-de56844f-21dc-4245-83b9-6bd2e49a13fa tempest-VolumesMetadataTest-1554473363 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:55:00 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de56844f-21dc-4245-83b9-6bd2e49a13fa tempest-VolumesMetadataTest-1554473363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:55:00 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-de56844f-21dc-4245-83b9-6bd2e49a13fa tempest-VolumesMetadataTest-1554473363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09f3d8a8-d1d6-46d2-aa3b-aa5c38e0d04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3373479-ee32-4210-ac4b-d141bc030d05', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:55:00 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-de56844f-21dc-4245-83b9-6bd2e49a13fa tempest-VolumesMetadataTest-1554473363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39932db3-70b9-4194-950e-4d9294f65097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:55:00 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-de56844f-21dc-4245-83b9-6bd2e49a13fa tempest-VolumesMetadataTest-1554473363 None] Volume volume-e3373479-ee32-4210-ac4b-d141bc030d05 (e3373479-ee32-4210-ac4b-d141bc030d05): created successfully Apr 24 13:55:00 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-de56844f-21dc-4245-83b9-6bd2e49a13fa tempest-VolumesMetadataTest-1554473363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39932db3-70b9-4194-950e-4d9294f65097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:55:00 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-de56844f-21dc-4245-83b9-6bd2e49a13fa tempest-VolumesMetadataTest-1554473363 None] Flow 'volume_create_manager' (b6c23dec-d259-4f1a-8c20-49c3495a2f35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:55:00 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-de56844f-21dc-4245-83b9-6bd2e49a13fa tempest-VolumesMetadataTest-1554473363 None] Created volume successfully. Apr 24 13:55:00 devstack sudo[89574]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:00 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bd0e62bb-344d-4ef7-9f14-65dce5c8927f tempest-SnapshotDependencyTests-618444304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d.98856edd-ba58-44bf-9610-8f1c0fc8d766" returned: 0 in 0.611s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:00 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-bd0e62bb-344d-4ef7-9f14-65dce5c8927f tempest-SnapshotDependencyTests-618444304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0dbac441-f3b3-4468-999b-04534bebf48d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:55:00 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[2907b5e5-9636-4be3-a71f-68ce2bb1d40f]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:55:00 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bd0e62bb-344d-4ef7-9f14-65dce5c8927f tempest-SnapshotDependencyTests-618444304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:00 devstack sudo[89580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d Apr 24 13:55:00 devstack sudo[89580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:01 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d997b480-01fc-4de9-b3f7-a9340541d178 tempest-VolumesMetadataTest-1554473363 None] Acquiring lock "cinder-e3373479-ee32-4210-ac4b-d141bc030d05-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:55:01 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d997b480-01fc-4de9-b3f7-a9340541d178 tempest-VolumesMetadataTest-1554473363 None] Lock "cinder-e3373479-ee32-4210-ac4b-d141bc030d05-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:55:01 devstack sudo[89580]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bd0e62bb-344d-4ef7-9f14-65dce5c8927f tempest-SnapshotDependencyTests-618444304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d" returned: 0 in 0.653s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bd0e62bb-344d-4ef7-9f14-65dce5c8927f tempest-SnapshotDependencyTests-618444304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d.98856edd-ba58-44bf-9610-8f1c0fc8d766 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:01 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d997b480-01fc-4de9-b3f7-a9340541d178 tempest-VolumesMetadataTest-1554473363 None] Acquiring lock "cinder-quobyte-e3373479-ee32-4210-ac4b-d141bc030d05" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:55:01 devstack sudo[89687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d.98856edd-ba58-44bf-9610-8f1c0fc8d766 Apr 24 13:55:01 devstack sudo[89687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:01 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d997b480-01fc-4de9-b3f7-a9340541d178 tempest-VolumesMetadataTest-1554473363 None] Lock "cinder-quobyte-e3373479-ee32-4210-ac4b-d141bc030d05" acquired by "delete_volume" :: waited 0.018s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:55:01 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ce7c9a-a3d2-43a5-94a1-9b6e310998eb]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:55:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d997b480-01fc-4de9-b3f7-a9340541d178 tempest-VolumesMetadataTest-1554473363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e3373479-ee32-4210-ac4b-d141bc030d05 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:01 devstack sudo[89727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e3373479-ee32-4210-ac4b-d141bc030d05 Apr 24 13:55:01 devstack sudo[89727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:01 devstack sudo[89687]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bd0e62bb-344d-4ef7-9f14-65dce5c8927f tempest-SnapshotDependencyTests-618444304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d.98856edd-ba58-44bf-9610-8f1c0fc8d766" returned: 0 in 0.598s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bd0e62bb-344d-4ef7-9f14-65dce5c8927f tempest-SnapshotDependencyTests-618444304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d.98856edd-ba58-44bf-9610-8f1c0fc8d766 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:01 devstack sudo[89727]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d997b480-01fc-4de9-b3f7-a9340541d178 tempest-VolumesMetadataTest-1554473363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e3373479-ee32-4210-ac4b-d141bc030d05" returned: 0 in 0.553s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d997b480-01fc-4de9-b3f7-a9340541d178 tempest-VolumesMetadataTest-1554473363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e3373479-ee32-4210-ac4b-d141bc030d05 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:01 devstack sudo[89736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d.98856edd-ba58-44bf-9610-8f1c0fc8d766 Apr 24 13:55:01 devstack sudo[89736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:01 devstack sudo[89737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e3373479-ee32-4210-ac4b-d141bc030d05 Apr 24 13:55:01 devstack sudo[89737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:02 devstack sudo[89737]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d997b480-01fc-4de9-b3f7-a9340541d178 tempest-VolumesMetadataTest-1554473363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e3373479-ee32-4210-ac4b-d141bc030d05" returned: 0 in 0.442s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:02 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d997b480-01fc-4de9-b3f7-a9340541d178 tempest-VolumesMetadataTest-1554473363 None] Lock "cinder-quobyte-e3373479-ee32-4210-ac4b-d141bc030d05" released by "delete_volume" :: held 1.040s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:55:02 devstack sudo[89736]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bd0e62bb-344d-4ef7-9f14-65dce5c8927f tempest-SnapshotDependencyTests-618444304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d.98856edd-ba58-44bf-9610-8f1c0fc8d766" returned: 0 in 0.516s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:02 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-d997b480-01fc-4de9-b3f7-a9340541d178 tempest-VolumesMetadataTest-1554473363 None] Created reservations ['95e0fbdf-b964-49f1-8c99-c05d9256a09a', '3718019d-1385-432c-a050-704488749369', 'ce700b5a-5165-4204-8535-b09a7d6ad720', 'd16f7ebb-0567-421c-a0d1-f25aa00d3854'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:55:02 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-bd0e62bb-344d-4ef7-9f14-65dce5c8927f tempest-SnapshotDependencyTests-618444304 None] Lock "cinder-quobyte-98856edd-ba58-44bf-9610-8f1c0fc8d766" released by "_delete_snapshot" :: held 2.477s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:55:02 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-bd0e62bb-344d-4ef7-9f14-65dce5c8927f tempest-SnapshotDependencyTests-618444304 None] Lock "cinder-quobyte-0dbac441-f3b3-4468-999b-04534bebf48d" released by "delete_snapshot" :: held 2.512s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:55:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d997b480-01fc-4de9-b3f7-a9340541d178 tempest-VolumesMetadataTest-1554473363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:55:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d997b480-01fc-4de9-b3f7-a9340541d178 tempest-VolumesMetadataTest-1554473363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:55:02 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-d997b480-01fc-4de9-b3f7-a9340541d178 tempest-VolumesMetadataTest-1554473363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:55:02 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-d997b480-01fc-4de9-b3f7-a9340541d178 tempest-VolumesMetadataTest-1554473363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:55:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d997b480-01fc-4de9-b3f7-a9340541d178 tempest-VolumesMetadataTest-1554473363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:55:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d997b480-01fc-4de9-b3f7-a9340541d178 tempest-VolumesMetadataTest-1554473363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:02 devstack sudo[89742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:55:02 devstack sudo[89742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:02 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-bd0e62bb-344d-4ef7-9f14-65dce5c8927f tempest-SnapshotDependencyTests-618444304 None] Created reservations ['7ec7c1d9-23e1-4ec2-929b-63610a285a62', '7a800e86-c0ac-4e36-b6d0-c99e858c609f', '4b1cb7bf-e0e8-4ddf-b2dd-f365536a3363', 'b9a771d4-d1aa-4a18-aa87-70eb08f388a9'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:55:02 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-bd0e62bb-344d-4ef7-9f14-65dce5c8927f tempest-SnapshotDependencyTests-618444304 None] Delete snapshot completed successfully. Apr 24 13:55:02 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-bd0e62bb-344d-4ef7-9f14-65dce5c8927f tempest-SnapshotDependencyTests-618444304 None] Lock "cinder-98856edd-ba58-44bf-9610-8f1c0fc8d766-delete_snapshot" released by "delete_snapshot" :: held 2.749s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:55:02 devstack sudo[89742]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d997b480-01fc-4de9-b3f7-a9340541d178 tempest-VolumesMetadataTest-1554473363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.429s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:02 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-d997b480-01fc-4de9-b3f7-a9340541d178 tempest-VolumesMetadataTest-1554473363 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:55:02 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-d997b480-01fc-4de9-b3f7-a9340541d178 tempest-VolumesMetadataTest-1554473363 None] Deleted volume successfully. Apr 24 13:55:03 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d997b480-01fc-4de9-b3f7-a9340541d178 tempest-VolumesMetadataTest-1554473363 None] Lock "cinder-e3373479-ee32-4210-ac4b-d141bc030d05-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:55:03 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-36f19a04-07cf-499d-b87b-82e18db38bf9 tempest-SnapshotDependencyTests-618444304 None] Acquiring lock "cinder-0dbac441-f3b3-4468-999b-04534bebf48d-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:55:03 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-36f19a04-07cf-499d-b87b-82e18db38bf9 tempest-SnapshotDependencyTests-618444304 None] Lock "cinder-0dbac441-f3b3-4468-999b-04534bebf48d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:55:03 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-36f19a04-07cf-499d-b87b-82e18db38bf9 tempest-SnapshotDependencyTests-618444304 None] Acquiring lock "cinder-quobyte-0dbac441-f3b3-4468-999b-04534bebf48d" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:55:03 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-36f19a04-07cf-499d-b87b-82e18db38bf9 tempest-SnapshotDependencyTests-618444304 None] Lock "cinder-quobyte-0dbac441-f3b3-4468-999b-04534bebf48d" acquired by "delete_volume" :: waited 0.016s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:55:03 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7d7a2c-4ee8-4cbf-8538-05f13994ea0d]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:55:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-36f19a04-07cf-499d-b87b-82e18db38bf9 tempest-SnapshotDependencyTests-618444304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:03 devstack sudo[89745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d Apr 24 13:55:03 devstack sudo[89745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:03 devstack sudo[89745]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-36f19a04-07cf-499d-b87b-82e18db38bf9 tempest-SnapshotDependencyTests-618444304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d" returned: 0 in 0.602s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-36f19a04-07cf-499d-b87b-82e18db38bf9 tempest-SnapshotDependencyTests-618444304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:03 devstack sudo[89750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d Apr 24 13:55:03 devstack sudo[89750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:04 devstack sudo[89750]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:04 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-36f19a04-07cf-499d-b87b-82e18db38bf9 tempest-SnapshotDependencyTests-618444304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-0dbac441-f3b3-4468-999b-04534bebf48d" returned: 0 in 0.531s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:04 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-36f19a04-07cf-499d-b87b-82e18db38bf9 tempest-SnapshotDependencyTests-618444304 None] Lock "cinder-quobyte-0dbac441-f3b3-4468-999b-04534bebf48d" released by "delete_volume" :: held 1.194s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:55:04 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-36f19a04-07cf-499d-b87b-82e18db38bf9 tempest-SnapshotDependencyTests-618444304 None] Created reservations ['91cc19de-4580-4ff6-99e0-e956593fee08', '8b5d3ddb-1762-4fe0-865b-7cc5209caeab', 'f25c85e9-72ca-4f0c-85e4-a636d786e2fc', 'b9d0e4c0-78b1-4d76-a2d7-53d1ffbe1d97'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:55:04 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-36f19a04-07cf-499d-b87b-82e18db38bf9 tempest-SnapshotDependencyTests-618444304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:55:04 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-36f19a04-07cf-499d-b87b-82e18db38bf9 tempest-SnapshotDependencyTests-618444304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:55:04 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-36f19a04-07cf-499d-b87b-82e18db38bf9 tempest-SnapshotDependencyTests-618444304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:55:04 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-36f19a04-07cf-499d-b87b-82e18db38bf9 tempest-SnapshotDependencyTests-618444304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:55:04 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-36f19a04-07cf-499d-b87b-82e18db38bf9 tempest-SnapshotDependencyTests-618444304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:55:04 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-36f19a04-07cf-499d-b87b-82e18db38bf9 tempest-SnapshotDependencyTests-618444304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:04 devstack sudo[89753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:55:04 devstack sudo[89753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:05 devstack sudo[89753]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:05 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-36f19a04-07cf-499d-b87b-82e18db38bf9 tempest-SnapshotDependencyTests-618444304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.542s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:05 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-36f19a04-07cf-499d-b87b-82e18db38bf9 tempest-SnapshotDependencyTests-618444304 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:55:05 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-36f19a04-07cf-499d-b87b-82e18db38bf9 tempest-SnapshotDependencyTests-618444304 None] Deleted volume successfully. Apr 24 13:55:05 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-36f19a04-07cf-499d-b87b-82e18db38bf9 tempest-SnapshotDependencyTests-618444304 None] Lock "cinder-0dbac441-f3b3-4468-999b-04534bebf48d-delete_volume" released by "delete_volume" :: held 1.967s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:55:05 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-7ce0f684-4fff-48f9-b57a-ed2c5a7ad686 tempest-SnapshotDependencyTests-618444304 None] Acquiring lock "cinder-44374df2-936d-4fbb-a173-52d549b0ddd7-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:55:05 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-7ce0f684-4fff-48f9-b57a-ed2c5a7ad686 tempest-SnapshotDependencyTests-618444304 None] Lock "cinder-44374df2-936d-4fbb-a173-52d549b0ddd7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:55:05 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-7ce0f684-4fff-48f9-b57a-ed2c5a7ad686 tempest-SnapshotDependencyTests-618444304 None] Acquiring lock "cinder-quobyte-44374df2-936d-4fbb-a173-52d549b0ddd7" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:55:05 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-7ce0f684-4fff-48f9-b57a-ed2c5a7ad686 tempest-SnapshotDependencyTests-618444304 None] Lock "cinder-quobyte-44374df2-936d-4fbb-a173-52d549b0ddd7" acquired by "delete_volume" :: waited 0.015s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:55:05 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[58cbe90b-e148-4926-8f82-0a106f3008e7]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:55:05 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7ce0f684-4fff-48f9-b57a-ed2c5a7ad686 tempest-SnapshotDependencyTests-618444304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44374df2-936d-4fbb-a173-52d549b0ddd7 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:05 devstack sudo[89756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44374df2-936d-4fbb-a173-52d549b0ddd7 Apr 24 13:55:05 devstack sudo[89756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:06 devstack cinder-volume[82046]: DEBUG dbcounter [-] [82046] Writing DB stats cinder:UPDATE=154,cinder:SELECT=123,cinder:INSERT=45,cinder:DELETE=9 {{(pid=82046) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 13:55:06 devstack sudo[89756]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7ce0f684-4fff-48f9-b57a-ed2c5a7ad686 tempest-SnapshotDependencyTests-618444304 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44374df2-936d-4fbb-a173-52d549b0ddd7" returned: 0 in 0.685s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7ce0f684-4fff-48f9-b57a-ed2c5a7ad686 tempest-SnapshotDependencyTests-618444304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44374df2-936d-4fbb-a173-52d549b0ddd7 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:06 devstack sudo[89763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44374df2-936d-4fbb-a173-52d549b0ddd7 Apr 24 13:55:06 devstack sudo[89763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:06 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-f26564a7-16d3-4942-bb3d-76a0208d12ae tempest-VolumesGetTest-1964773963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:55:06 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f26564a7-16d3-4942-bb3d-76a0208d12ae tempest-VolumesGetTest-1964773963 None] Flow 'volume_create_manager' (fda026a6-b198-49e0-aac9-f722d612f2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:55:06 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f26564a7-16d3-4942-bb3d-76a0208d12ae tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2c4bc77-7af5-43a6-9004-d5e20c7e019a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:55:06 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f26564a7-16d3-4942-bb3d-76a0208d12ae tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2c4bc77-7af5-43a6-9004-d5e20c7e019a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1910268463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=964d4fd9-0260-4922-8e72-552209112d51,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1ea76121a590498e8b5cdcb0702af588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:55:06Z,use_quota=True,user_id='cf706cc8f3ea45e4abcce32a1d1ce12d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:55:06 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f26564a7-16d3-4942-bb3d-76a0208d12ae tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb4da5b8-a2ee-4d6b-9c46-f8f04c7c7449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:55:06 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f26564a7-16d3-4942-bb3d-76a0208d12ae tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb4da5b8-a2ee-4d6b-9c46-f8f04c7c7449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:55:06 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f26564a7-16d3-4942-bb3d-76a0208d12ae tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffad9322-d989-4136-9b17-3f934d0578af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:55:06 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f26564a7-16d3-4942-bb3d-76a0208d12ae tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffad9322-d989-4136-9b17-3f934d0578af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '964d4fd9-0260-4922-8e72-552209112d51', 'volume_name': 'volume-964d4fd9-0260-4922-8e72-552209112d51', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:55:06 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f26564a7-16d3-4942-bb3d-76a0208d12ae tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff7195e0-cbc9-4827-9854-6171b86f9b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:55:06 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f26564a7-16d3-4942-bb3d-76a0208d12ae tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff7195e0-cbc9-4827-9854-6171b86f9b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:55:06 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f26564a7-16d3-4942-bb3d-76a0208d12ae tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7784e798-3a53-40c8-ac6e-16530a45e7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:55:06 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-f26564a7-16d3-4942-bb3d-76a0208d12ae tempest-VolumesGetTest-1964773963 None] Volume 964d4fd9-0260-4922-8e72-552209112d51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-964d4fd9-0260-4922-8e72-552209112d51', 'volume_size': 1} Apr 24 13:55:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f26564a7-16d3-4942-bb3d-76a0208d12ae tempest-VolumesGetTest-1964773963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:55:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f26564a7-16d3-4942-bb3d-76a0208d12ae tempest-VolumesGetTest-1964773963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:55:06 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-f26564a7-16d3-4942-bb3d-76a0208d12ae tempest-VolumesGetTest-1964773963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1910268463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=964d4fd9-0260-4922-8e72-552209112d51,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1ea76121a590498e8b5cdcb0702af588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:55:06Z,use_quota=True,user_id='cf706cc8f3ea45e4abcce32a1d1ce12d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:55:06 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-f26564a7-16d3-4942-bb3d-76a0208d12ae tempest-VolumesGetTest-1964773963 None] Creating volume 964d4fd9-0260-4922-8e72-552209112d51 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:55:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f26564a7-16d3-4942-bb3d-76a0208d12ae tempest-VolumesGetTest-1964773963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:55:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f26564a7-16d3-4942-bb3d-76a0208d12ae tempest-VolumesGetTest-1964773963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:55:06 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-f26564a7-16d3-4942-bb3d-76a0208d12ae tempest-VolumesGetTest-1964773963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:55:06 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-f26564a7-16d3-4942-bb3d-76a0208d12ae tempest-VolumesGetTest-1964773963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:55:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f26564a7-16d3-4942-bb3d-76a0208d12ae tempest-VolumesGetTest-1964773963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:55:06 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-f26564a7-16d3-4942-bb3d-76a0208d12ae tempest-VolumesGetTest-1964773963 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:55:06 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-f26564a7-16d3-4942-bb3d-76a0208d12ae tempest-VolumesGetTest-1964773963 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:55:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f26564a7-16d3-4942-bb3d-76a0208d12ae tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-964d4fd9-0260-4922-8e72-552209112d51 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:06 devstack sudo[89765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-964d4fd9-0260-4922-8e72-552209112d51 1073741824 Apr 24 13:55:06 devstack sudo[89765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:06 devstack sudo[89763]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7ce0f684-4fff-48f9-b57a-ed2c5a7ad686 tempest-SnapshotDependencyTests-618444304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-44374df2-936d-4fbb-a173-52d549b0ddd7" returned: 0 in 0.490s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:06 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-7ce0f684-4fff-48f9-b57a-ed2c5a7ad686 tempest-SnapshotDependencyTests-618444304 None] Lock "cinder-quobyte-44374df2-936d-4fbb-a173-52d549b0ddd7" released by "delete_volume" :: held 1.226s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:55:06 devstack cinder-volume[82046]: DEBUG dbcounter [-] [82046] Writing DB stats cinder:SELECT=110,cinder:UPDATE=139,cinder:DELETE=17,cinder:INSERT=38 {{(pid=82046) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 13:55:06 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-7ce0f684-4fff-48f9-b57a-ed2c5a7ad686 tempest-SnapshotDependencyTests-618444304 None] Created reservations ['ab7b903c-59c0-4db9-950b-283f33ee2cb2', '9fe30e9a-5f39-4dc6-80cb-a001c1bb351c', 'a70eade1-614c-465b-976d-0e2b2dd0f6e1', 'a2bf7637-91b9-4bcd-ae14-6236d932ee33'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:55:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-7ce0f684-4fff-48f9-b57a-ed2c5a7ad686 tempest-SnapshotDependencyTests-618444304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:55:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-7ce0f684-4fff-48f9-b57a-ed2c5a7ad686 tempest-SnapshotDependencyTests-618444304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:55:06 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-7ce0f684-4fff-48f9-b57a-ed2c5a7ad686 tempest-SnapshotDependencyTests-618444304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:55:06 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-7ce0f684-4fff-48f9-b57a-ed2c5a7ad686 tempest-SnapshotDependencyTests-618444304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:55:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-7ce0f684-4fff-48f9-b57a-ed2c5a7ad686 tempest-SnapshotDependencyTests-618444304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:55:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7ce0f684-4fff-48f9-b57a-ed2c5a7ad686 tempest-SnapshotDependencyTests-618444304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:06 devstack sudo[89771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:55:06 devstack sudo[89771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:06 devstack sudo[89765]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f26564a7-16d3-4942-bb3d-76a0208d12ae tempest-VolumesGetTest-1964773963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-964d4fd9-0260-4922-8e72-552209112d51 1073741824" returned: 0 in 0.733s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f26564a7-16d3-4942-bb3d-76a0208d12ae tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-964d4fd9-0260-4922-8e72-552209112d51 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:07 devstack sudo[89773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-964d4fd9-0260-4922-8e72-552209112d51 Apr 24 13:55:07 devstack sudo[89773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:07 devstack sudo[89771]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7ce0f684-4fff-48f9-b57a-ed2c5a7ad686 tempest-SnapshotDependencyTests-618444304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.508s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:07 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-7ce0f684-4fff-48f9-b57a-ed2c5a7ad686 tempest-SnapshotDependencyTests-618444304 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:55:07 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-7ce0f684-4fff-48f9-b57a-ed2c5a7ad686 tempest-SnapshotDependencyTests-618444304 None] Deleted volume successfully. Apr 24 13:55:07 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-7ce0f684-4fff-48f9-b57a-ed2c5a7ad686 tempest-SnapshotDependencyTests-618444304 None] Lock "cinder-44374df2-936d-4fbb-a173-52d549b0ddd7-delete_volume" released by "delete_volume" :: held 1.972s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:55:07 devstack sudo[89773]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f26564a7-16d3-4942-bb3d-76a0208d12ae tempest-VolumesGetTest-1964773963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-964d4fd9-0260-4922-8e72-552209112d51" returned: 0 in 0.494s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:07 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-f26564a7-16d3-4942-bb3d-76a0208d12ae tempest-VolumesGetTest-1964773963 None] <== create_volume: return (1272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:55:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f26564a7-16d3-4942-bb3d-76a0208d12ae tempest-VolumesGetTest-1964773963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:55:07 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f26564a7-16d3-4942-bb3d-76a0208d12ae tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7784e798-3a53-40c8-ac6e-16530a45e7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-964d4fd9-0260-4922-8e72-552209112d51', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:55:07 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f26564a7-16d3-4942-bb3d-76a0208d12ae tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (930d7457-a927-42d1-8efe-25baae84b4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:55:07 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-f26564a7-16d3-4942-bb3d-76a0208d12ae tempest-VolumesGetTest-1964773963 None] Volume volume-964d4fd9-0260-4922-8e72-552209112d51 (964d4fd9-0260-4922-8e72-552209112d51): created successfully Apr 24 13:55:07 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f26564a7-16d3-4942-bb3d-76a0208d12ae tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (930d7457-a927-42d1-8efe-25baae84b4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:55:07 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f26564a7-16d3-4942-bb3d-76a0208d12ae tempest-VolumesGetTest-1964773963 None] Flow 'volume_create_manager' (fda026a6-b198-49e0-aac9-f722d612f2d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:55:07 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-f26564a7-16d3-4942-bb3d-76a0208d12ae tempest-VolumesGetTest-1964773963 None] Created volume successfully. Apr 24 13:55:08 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-34c3c674-e6a9-4894-953b-55807d7bac31 tempest-VolumesGetTest-1964773963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:55:08 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-34c3c674-e6a9-4894-953b-55807d7bac31 tempest-VolumesGetTest-1964773963 None] Flow 'volume_create_manager' (df1b94fb-122b-4af5-b77b-0910f92d7d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:55:08 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-34c3c674-e6a9-4894-953b-55807d7bac31 tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dcef671-ca72-4084-93c8-02a3875a5c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:55:08 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-34c3c674-e6a9-4894-953b-55807d7bac31 tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dcef671-ca72-4084-93c8-02a3875a5c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:55:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-120570336',display_name='tempest-VolumesGetTest-Volume-437433129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3c94d4e-62e2-4ae1-adb2-8066948b8a88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ea76121a590498e8b5cdcb0702af588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:55:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:55:09Z,use_quota=True,user_id='cf706cc8f3ea45e4abcce32a1d1ce12d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:55:08 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-34c3c674-e6a9-4894-953b-55807d7bac31 tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f6427f-9802-425d-91e2-9986b706ecd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:55:08 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-34c3c674-e6a9-4894-953b-55807d7bac31 tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f6427f-9802-425d-91e2-9986b706ecd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:55:08 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-34c3c674-e6a9-4894-953b-55807d7bac31 tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27652684-debb-418e-95f3-cb2685e0a5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:55:08 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-34c3c674-e6a9-4894-953b-55807d7bac31 tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27652684-debb-418e-95f3-cb2685e0a5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3c94d4e-62e2-4ae1-adb2-8066948b8a88', 'volume_name': 'volume-b3c94d4e-62e2-4ae1-adb2-8066948b8a88', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:55:08 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-34c3c674-e6a9-4894-953b-55807d7bac31 tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5c8dc51-70e9-48bc-957e-7568ac908fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:55:08 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-34c3c674-e6a9-4894-953b-55807d7bac31 tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5c8dc51-70e9-48bc-957e-7568ac908fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:55:09 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-34c3c674-e6a9-4894-953b-55807d7bac31 tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92c25f93-5697-430b-97d1-fc7f51f85532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:55:09 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-34c3c674-e6a9-4894-953b-55807d7bac31 tempest-VolumesGetTest-1964773963 None] Volume b3c94d4e-62e2-4ae1-adb2-8066948b8a88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3c94d4e-62e2-4ae1-adb2-8066948b8a88', 'volume_size': 1} Apr 24 13:55:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-34c3c674-e6a9-4894-953b-55807d7bac31 tempest-VolumesGetTest-1964773963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:55:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-34c3c674-e6a9-4894-953b-55807d7bac31 tempest-VolumesGetTest-1964773963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:55:09 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-34c3c674-e6a9-4894-953b-55807d7bac31 tempest-VolumesGetTest-1964773963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:55:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-120570336',display_name='tempest-VolumesGetTest-Volume-437433129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3c94d4e-62e2-4ae1-adb2-8066948b8a88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ea76121a590498e8b5cdcb0702af588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:55:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:55:09Z,use_quota=True,user_id='cf706cc8f3ea45e4abcce32a1d1ce12d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:55:09 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-34c3c674-e6a9-4894-953b-55807d7bac31 tempest-VolumesGetTest-1964773963 None] Creating volume b3c94d4e-62e2-4ae1-adb2-8066948b8a88 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:55:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-34c3c674-e6a9-4894-953b-55807d7bac31 tempest-VolumesGetTest-1964773963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:55:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-34c3c674-e6a9-4894-953b-55807d7bac31 tempest-VolumesGetTest-1964773963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:55:09 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-34c3c674-e6a9-4894-953b-55807d7bac31 tempest-VolumesGetTest-1964773963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:55:09 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-34c3c674-e6a9-4894-953b-55807d7bac31 tempest-VolumesGetTest-1964773963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:55:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-34c3c674-e6a9-4894-953b-55807d7bac31 tempest-VolumesGetTest-1964773963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:55:09 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-34c3c674-e6a9-4894-953b-55807d7bac31 tempest-VolumesGetTest-1964773963 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:55:09 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-34c3c674-e6a9-4894-953b-55807d7bac31 tempest-VolumesGetTest-1964773963 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:55:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-34c3c674-e6a9-4894-953b-55807d7bac31 tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b3c94d4e-62e2-4ae1-adb2-8066948b8a88 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:09 devstack sudo[89778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b3c94d4e-62e2-4ae1-adb2-8066948b8a88 1073741824 Apr 24 13:55:09 devstack sudo[89778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:09 devstack sudo[89778]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-34c3c674-e6a9-4894-953b-55807d7bac31 tempest-VolumesGetTest-1964773963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b3c94d4e-62e2-4ae1-adb2-8066948b8a88 1073741824" returned: 0 in 0.728s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-34c3c674-e6a9-4894-953b-55807d7bac31 tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b3c94d4e-62e2-4ae1-adb2-8066948b8a88 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:09 devstack sudo[89784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b3c94d4e-62e2-4ae1-adb2-8066948b8a88 Apr 24 13:55:09 devstack sudo[89784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:10 devstack sudo[89784]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:10 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-34c3c674-e6a9-4894-953b-55807d7bac31 tempest-VolumesGetTest-1964773963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b3c94d4e-62e2-4ae1-adb2-8066948b8a88" returned: 0 in 0.530s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:10 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-34c3c674-e6a9-4894-953b-55807d7bac31 tempest-VolumesGetTest-1964773963 None] <== create_volume: return (1304ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:55:10 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-34c3c674-e6a9-4894-953b-55807d7bac31 tempest-VolumesGetTest-1964773963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.308s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:55:10 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-34c3c674-e6a9-4894-953b-55807d7bac31 tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92c25f93-5697-430b-97d1-fc7f51f85532) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3c94d4e-62e2-4ae1-adb2-8066948b8a88', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:55:10 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-34c3c674-e6a9-4894-953b-55807d7bac31 tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fe35ae0-b6ea-4d94-b1fa-ead52960c8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:55:10 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-34c3c674-e6a9-4894-953b-55807d7bac31 tempest-VolumesGetTest-1964773963 None] Volume volume-b3c94d4e-62e2-4ae1-adb2-8066948b8a88 (b3c94d4e-62e2-4ae1-adb2-8066948b8a88): created successfully Apr 24 13:55:10 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-34c3c674-e6a9-4894-953b-55807d7bac31 tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fe35ae0-b6ea-4d94-b1fa-ead52960c8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:55:10 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-34c3c674-e6a9-4894-953b-55807d7bac31 tempest-VolumesGetTest-1964773963 None] Flow 'volume_create_manager' (df1b94fb-122b-4af5-b77b-0910f92d7d50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:55:10 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-34c3c674-e6a9-4894-953b-55807d7bac31 tempest-VolumesGetTest-1964773963 None] Created volume successfully. Apr 24 13:55:11 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ab37167e-e7f2-4578-9e04-b82e35b95640 tempest-VolumesGetTest-1964773963 None] Acquiring lock "cinder-b3c94d4e-62e2-4ae1-adb2-8066948b8a88-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:55:11 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ab37167e-e7f2-4578-9e04-b82e35b95640 tempest-VolumesGetTest-1964773963 None] Lock "cinder-b3c94d4e-62e2-4ae1-adb2-8066948b8a88-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:55:11 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ab37167e-e7f2-4578-9e04-b82e35b95640 tempest-VolumesGetTest-1964773963 None] Acquiring lock "cinder-quobyte-b3c94d4e-62e2-4ae1-adb2-8066948b8a88" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:55:11 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ab37167e-e7f2-4578-9e04-b82e35b95640 tempest-VolumesGetTest-1964773963 None] Lock "cinder-quobyte-b3c94d4e-62e2-4ae1-adb2-8066948b8a88" acquired by "delete_volume" :: waited 0.034s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:55:11 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[56953869-fdf7-4438-aa94-3c6d655cfd3a]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:55:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ab37167e-e7f2-4578-9e04-b82e35b95640 tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b3c94d4e-62e2-4ae1-adb2-8066948b8a88 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:11 devstack sudo[89787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b3c94d4e-62e2-4ae1-adb2-8066948b8a88 Apr 24 13:55:11 devstack sudo[89787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:12 devstack sudo[89787]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ab37167e-e7f2-4578-9e04-b82e35b95640 tempest-VolumesGetTest-1964773963 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b3c94d4e-62e2-4ae1-adb2-8066948b8a88" returned: 0 in 0.740s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ab37167e-e7f2-4578-9e04-b82e35b95640 tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b3c94d4e-62e2-4ae1-adb2-8066948b8a88 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:12 devstack sudo[89793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b3c94d4e-62e2-4ae1-adb2-8066948b8a88 Apr 24 13:55:12 devstack sudo[89793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:12 devstack sudo[89793]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ab37167e-e7f2-4578-9e04-b82e35b95640 tempest-VolumesGetTest-1964773963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b3c94d4e-62e2-4ae1-adb2-8066948b8a88" returned: 0 in 0.537s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:12 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ab37167e-e7f2-4578-9e04-b82e35b95640 tempest-VolumesGetTest-1964773963 None] Lock "cinder-quobyte-b3c94d4e-62e2-4ae1-adb2-8066948b8a88" released by "delete_volume" :: held 1.324s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:55:12 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-ab37167e-e7f2-4578-9e04-b82e35b95640 tempest-VolumesGetTest-1964773963 None] Created reservations ['57bba368-a6c4-4525-848f-0213963aeee4', '436ab7f7-642f-4e84-b2a4-2d0f71557b18', '9a2fcd96-b192-49f6-bac1-49e0714c9cb7', 'd31a20df-c5b6-492a-939d-942fc25d61d1'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:55:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-ab37167e-e7f2-4578-9e04-b82e35b95640 tempest-VolumesGetTest-1964773963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:55:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-ab37167e-e7f2-4578-9e04-b82e35b95640 tempest-VolumesGetTest-1964773963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:55:12 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-ab37167e-e7f2-4578-9e04-b82e35b95640 tempest-VolumesGetTest-1964773963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:55:12 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-ab37167e-e7f2-4578-9e04-b82e35b95640 tempest-VolumesGetTest-1964773963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:55:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-ab37167e-e7f2-4578-9e04-b82e35b95640 tempest-VolumesGetTest-1964773963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:55:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ab37167e-e7f2-4578-9e04-b82e35b95640 tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:12 devstack sudo[89796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:55:12 devstack sudo[89796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:13 devstack sudo[89796]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ab37167e-e7f2-4578-9e04-b82e35b95640 tempest-VolumesGetTest-1964773963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.563s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:13 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-ab37167e-e7f2-4578-9e04-b82e35b95640 tempest-VolumesGetTest-1964773963 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:55:13 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-ab37167e-e7f2-4578-9e04-b82e35b95640 tempest-VolumesGetTest-1964773963 None] Deleted volume successfully. Apr 24 13:55:13 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ab37167e-e7f2-4578-9e04-b82e35b95640 tempest-VolumesGetTest-1964773963 None] Lock "cinder-b3c94d4e-62e2-4ae1-adb2-8066948b8a88-delete_volume" released by "delete_volume" :: held 2.208s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:55:13 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-03a03461-6db3-4cba-b017-63c602f2226b tempest-VolumesGetTest-1964773963 None] Acquiring lock "cinder-964d4fd9-0260-4922-8e72-552209112d51-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:55:13 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-03a03461-6db3-4cba-b017-63c602f2226b tempest-VolumesGetTest-1964773963 None] Lock "cinder-964d4fd9-0260-4922-8e72-552209112d51-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:55:13 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-03a03461-6db3-4cba-b017-63c602f2226b tempest-VolumesGetTest-1964773963 None] Acquiring lock "cinder-quobyte-964d4fd9-0260-4922-8e72-552209112d51" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:55:13 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-03a03461-6db3-4cba-b017-63c602f2226b tempest-VolumesGetTest-1964773963 None] Lock "cinder-quobyte-964d4fd9-0260-4922-8e72-552209112d51" acquired by "delete_volume" :: waited 0.020s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:55:13 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03e6129-5d4e-4de9-90f8-b9b13648c2d3]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:55:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-03a03461-6db3-4cba-b017-63c602f2226b tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-964d4fd9-0260-4922-8e72-552209112d51 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:13 devstack sudo[89800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-964d4fd9-0260-4922-8e72-552209112d51 Apr 24 13:55:13 devstack sudo[89800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:14 devstack sudo[89800]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-03a03461-6db3-4cba-b017-63c602f2226b tempest-VolumesGetTest-1964773963 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-964d4fd9-0260-4922-8e72-552209112d51" returned: 0 in 0.649s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-03a03461-6db3-4cba-b017-63c602f2226b tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-964d4fd9-0260-4922-8e72-552209112d51 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:14 devstack sudo[89805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-964d4fd9-0260-4922-8e72-552209112d51 Apr 24 13:55:14 devstack sudo[89805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:14 devstack sudo[89805]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-03a03461-6db3-4cba-b017-63c602f2226b tempest-VolumesGetTest-1964773963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-964d4fd9-0260-4922-8e72-552209112d51" returned: 0 in 0.549s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:14 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-03a03461-6db3-4cba-b017-63c602f2226b tempest-VolumesGetTest-1964773963 None] Lock "cinder-quobyte-964d4fd9-0260-4922-8e72-552209112d51" released by "delete_volume" :: held 1.245s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:55:14 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-03a03461-6db3-4cba-b017-63c602f2226b tempest-VolumesGetTest-1964773963 None] Created reservations ['b8583113-e51a-41a1-9ad4-da7279bb844e', '54fee1d2-5034-41ec-b5b9-18310a4ac193', '445121a4-177b-42be-ad3e-68863e126b47', 'a32cc9c0-f420-4691-bff5-9ac3bfebcbb8'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:55:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-03a03461-6db3-4cba-b017-63c602f2226b tempest-VolumesGetTest-1964773963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:55:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-03a03461-6db3-4cba-b017-63c602f2226b tempest-VolumesGetTest-1964773963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:55:15 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-03a03461-6db3-4cba-b017-63c602f2226b tempest-VolumesGetTest-1964773963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:55:15 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-03a03461-6db3-4cba-b017-63c602f2226b tempest-VolumesGetTest-1964773963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:55:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-03a03461-6db3-4cba-b017-63c602f2226b tempest-VolumesGetTest-1964773963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:55:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-03a03461-6db3-4cba-b017-63c602f2226b tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:15 devstack sudo[89808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:55:15 devstack sudo[89808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:15 devstack sudo[89808]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-03a03461-6db3-4cba-b017-63c602f2226b tempest-VolumesGetTest-1964773963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.510s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:15 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-03a03461-6db3-4cba-b017-63c602f2226b tempest-VolumesGetTest-1964773963 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:55:15 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-03a03461-6db3-4cba-b017-63c602f2226b tempest-VolumesGetTest-1964773963 None] Deleted volume successfully. Apr 24 13:55:15 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-03a03461-6db3-4cba-b017-63c602f2226b tempest-VolumesGetTest-1964773963 None] Lock "cinder-964d4fd9-0260-4922-8e72-552209112d51-delete_volume" released by "delete_volume" :: held 2.030s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:55:16 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aae2c22-98f4-446d-94ff-59be7f9549ae tempest-VolumesGetTest-1964773963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:55:16 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-1aae2c22-98f4-446d-94ff-59be7f9549ae tempest-VolumesGetTest-1964773963 None] Flow 'volume_create_manager' (ed9f2fea-fe27-4cd0-bb22-34b70ec37442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:55:16 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-1aae2c22-98f4-446d-94ff-59be7f9549ae tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0312f2c-266c-4bdf-8053-042b92ce7060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:55:16 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-1aae2c22-98f4-446d-94ff-59be7f9549ae tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0312f2c-266c-4bdf-8053-042b92ce7060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-743670437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e8a06a4-370b-45b1-a851-b76c5a364e09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ea76121a590498e8b5cdcb0702af588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:55:16Z,use_quota=True,user_id='cf706cc8f3ea45e4abcce32a1d1ce12d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:55:16 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-1aae2c22-98f4-446d-94ff-59be7f9549ae tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7ac298f-7d02-4e21-8f17-649a2a8b4a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:55:16 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-1aae2c22-98f4-446d-94ff-59be7f9549ae tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7ac298f-7d02-4e21-8f17-649a2a8b4a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:55:16 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-1aae2c22-98f4-446d-94ff-59be7f9549ae tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d68bc7ab-10eb-497d-976b-8830226871a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:55:16 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-1aae2c22-98f4-446d-94ff-59be7f9549ae tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d68bc7ab-10eb-497d-976b-8830226871a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e8a06a4-370b-45b1-a851-b76c5a364e09', 'volume_name': 'volume-7e8a06a4-370b-45b1-a851-b76c5a364e09', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:55:16 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-1aae2c22-98f4-446d-94ff-59be7f9549ae tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (765d2e8c-5abe-4e5b-b5f3-47d589f01c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:55:16 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-1aae2c22-98f4-446d-94ff-59be7f9549ae tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (765d2e8c-5abe-4e5b-b5f3-47d589f01c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:55:16 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-1aae2c22-98f4-446d-94ff-59be7f9549ae tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9ba5ea1-74fd-4733-850a-862b1049798d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:55:16 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-1aae2c22-98f4-446d-94ff-59be7f9549ae tempest-VolumesGetTest-1964773963 None] Volume 7e8a06a4-370b-45b1-a851-b76c5a364e09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e8a06a4-370b-45b1-a851-b76c5a364e09', 'volume_size': 1} Apr 24 13:55:16 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-1aae2c22-98f4-446d-94ff-59be7f9549ae tempest-VolumesGetTest-1964773963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:55:16 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-1aae2c22-98f4-446d-94ff-59be7f9549ae tempest-VolumesGetTest-1964773963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:55:16 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-1aae2c22-98f4-446d-94ff-59be7f9549ae tempest-VolumesGetTest-1964773963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-743670437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e8a06a4-370b-45b1-a851-b76c5a364e09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ea76121a590498e8b5cdcb0702af588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:55:16Z,use_quota=True,user_id='cf706cc8f3ea45e4abcce32a1d1ce12d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:55:16 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-1aae2c22-98f4-446d-94ff-59be7f9549ae tempest-VolumesGetTest-1964773963 None] Creating volume 7e8a06a4-370b-45b1-a851-b76c5a364e09 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:55:16 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-1aae2c22-98f4-446d-94ff-59be7f9549ae tempest-VolumesGetTest-1964773963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:55:16 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-1aae2c22-98f4-446d-94ff-59be7f9549ae tempest-VolumesGetTest-1964773963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:55:16 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-1aae2c22-98f4-446d-94ff-59be7f9549ae tempest-VolumesGetTest-1964773963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:55:16 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-1aae2c22-98f4-446d-94ff-59be7f9549ae tempest-VolumesGetTest-1964773963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:55:16 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-1aae2c22-98f4-446d-94ff-59be7f9549ae tempest-VolumesGetTest-1964773963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:55:16 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-1aae2c22-98f4-446d-94ff-59be7f9549ae tempest-VolumesGetTest-1964773963 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:55:16 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-1aae2c22-98f4-446d-94ff-59be7f9549ae tempest-VolumesGetTest-1964773963 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:55:16 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-1aae2c22-98f4-446d-94ff-59be7f9549ae tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:16 devstack sudo[89813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09 1073741824 Apr 24 13:55:16 devstack sudo[89813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:17 devstack sudo[89813]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-1aae2c22-98f4-446d-94ff-59be7f9549ae tempest-VolumesGetTest-1964773963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09 1073741824" returned: 0 in 0.791s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-1aae2c22-98f4-446d-94ff-59be7f9549ae tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:17 devstack sudo[89818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09 Apr 24 13:55:17 devstack sudo[89818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:17 devstack sudo[89818]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-1aae2c22-98f4-446d-94ff-59be7f9549ae tempest-VolumesGetTest-1964773963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09" returned: 0 in 0.549s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:17 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-1aae2c22-98f4-446d-94ff-59be7f9549ae tempest-VolumesGetTest-1964773963 None] <== create_volume: return (1388ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:55:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-1aae2c22-98f4-446d-94ff-59be7f9549ae tempest-VolumesGetTest-1964773963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.393s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:55:17 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-1aae2c22-98f4-446d-94ff-59be7f9549ae tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9ba5ea1-74fd-4733-850a-862b1049798d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e8a06a4-370b-45b1-a851-b76c5a364e09', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:55:17 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-1aae2c22-98f4-446d-94ff-59be7f9549ae tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7f1fa40-6e74-4bfc-8921-26106244fc95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:55:17 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-1aae2c22-98f4-446d-94ff-59be7f9549ae tempest-VolumesGetTest-1964773963 None] Volume volume-7e8a06a4-370b-45b1-a851-b76c5a364e09 (7e8a06a4-370b-45b1-a851-b76c5a364e09): created successfully Apr 24 13:55:17 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-1aae2c22-98f4-446d-94ff-59be7f9549ae tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7f1fa40-6e74-4bfc-8921-26106244fc95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:55:17 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-1aae2c22-98f4-446d-94ff-59be7f9549ae tempest-VolumesGetTest-1964773963 None] Flow 'volume_create_manager' (ed9f2fea-fe27-4cd0-bb22-34b70ec37442) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:55:17 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-1aae2c22-98f4-446d-94ff-59be7f9549ae tempest-VolumesGetTest-1964773963 None] Created volume successfully. Apr 24 13:55:18 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:55:18 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Flow 'volume_create_manager' (aa806671-1baf-4378-a9df-26bb97b91fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:55:18 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eab6c41-3e6e-4860-bc04-d100f90f2170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:55:18 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eab6c41-3e6e-4860-bc04-d100f90f2170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1987665911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d988efdc-beb9-4965-a2c9-714b5f35b9e0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1ea76121a590498e8b5cdcb0702af588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=7e8a06a4-370b-45b1-a851-b76c5a364e09,status='creating',terminated_at=None,updated_at=2026-04-24T11:55:19Z,use_quota=True,user_id='cf706cc8f3ea45e4abcce32a1d1ce12d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:55:18 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8e75107-b26d-4e9d-95bd-06e8fc0f8d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:55:18 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8e75107-b26d-4e9d-95bd-06e8fc0f8d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:55:18 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5259b562-016d-4bda-b0bd-f2560b57c9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:55:18 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5259b562-016d-4bda-b0bd-f2560b57c9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd988efdc-beb9-4965-a2c9-714b5f35b9e0', 'volume_name': 'volume-d988efdc-beb9-4965-a2c9-714b5f35b9e0', 'volume_size': 1, 'source_volid': '7e8a06a4-370b-45b1-a851-b76c5a364e09', 'source_volstatus': 'available'}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:55:18 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3e6bb5f-a735-4ccd-b43b-42839059f5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:55:18 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3e6bb5f-a735-4ccd-b43b-42839059f5a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:55:18 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6077f10b-ad3a-4502-b87a-e2f74d27c6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:55:18 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Volume d988efdc-beb9-4965-a2c9-714b5f35b9e0: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d988efdc-beb9-4965-a2c9-714b5f35b9e0', 'volume_size': 1, 'source_volid': '7e8a06a4-370b-45b1-a851-b76c5a364e09', 'source_volstatus': 'available'} Apr 24 13:55:18 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:55:18 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:55:18 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Cloning volume 7e8a06a4-370b-45b1-a851-b76c5a364e09 to volume d988efdc-beb9-4965-a2c9-714b5f35b9e0 Apr 24 13:55:18 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Creating offline snapshot 7b1d5be9-ab5d-4d93-aa5f-504aa1ea5c20 of volume 7e8a06a4-370b-45b1-a851-b76c5a364e09 {{(pid=82046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 13:55:18 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d65f2a-83a5-4593-916f-a19702f73b70]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:55:18 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:19 devstack sudo[89941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09 Apr 24 13:55:19 devstack sudo[89941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:19 devstack sudo[89941]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09" returned: 0 in 0.548s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09.7b1d5be9-ab5d-4d93-aa5f-504aa1ea5c20 1G {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:19 devstack sudo[89946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09.7b1d5be9-ab5d-4d93-aa5f-504aa1ea5c20 1G Apr 24 13:55:19 devstack sudo[89946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:20 devstack sudo[89946]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09.7b1d5be9-ab5d-4d93-aa5f-504aa1ea5c20 1G" returned: 0 in 0.646s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e8a06a4-370b-45b1-a851-b76c5a364e09 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09.7b1d5be9-ab5d-4d93-aa5f-504aa1ea5c20 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:20 devstack sudo[89951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e8a06a4-370b-45b1-a851-b76c5a364e09 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09.7b1d5be9-ab5d-4d93-aa5f-504aa1ea5c20 Apr 24 13:55:20 devstack sudo[89951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:20 devstack sudo[89951]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e8a06a4-370b-45b1-a851-b76c5a364e09 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09.7b1d5be9-ab5d-4d93-aa5f-504aa1ea5c20" returned: 0 in 0.507s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:20 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09.7b1d5be9-ab5d-4d93-aa5f-504aa1ea5c20 is being set with open permissions: ugo+rw Apr 24 13:55:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09.7b1d5be9-ab5d-4d93-aa5f-504aa1ea5c20 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:20 devstack sudo[89956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09.7b1d5be9-ab5d-4d93-aa5f-504aa1ea5c20 Apr 24 13:55:20 devstack sudo[89956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:21 devstack sudo[89956]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09.7b1d5be9-ab5d-4d93-aa5f-504aa1ea5c20" returned: 0 in 0.471s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:21 devstack sudo[89959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09.info Apr 24 13:55:21 devstack sudo[89959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:21 devstack sudo[89959]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09.info" returned: 0 in 0.473s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:21 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09.info is being set with open permissions: ugo+rw Apr 24 13:55:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:21 devstack sudo[89962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09.info Apr 24 13:55:21 devstack sudo[89962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:22 devstack sudo[89962]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09.info" returned: 0 in 0.519s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:22 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Acquiring lock "cinder-quobyte-d988efdc-beb9-4965-a2c9-714b5f35b9e0" by "_copy_volume_from_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:55:22 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Lock "cinder-quobyte-d988efdc-beb9-4965-a2c9-714b5f35b9e0" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:55:22 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] snapshot: 7b1d5be9-ab5d-4d93-aa5f-504aa1ea5c20, volume: d988efdc-beb9-4965-a2c9-714b5f35b9e0, {{(pid=82046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 13:55:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:55:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:55:22 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:55:22 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:55:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:55:22 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43a25df-8ec3-47b5-b1b6-e0c43d572e85]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:55:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09.7b1d5be9-ab5d-4d93-aa5f-504aa1ea5c20 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:22 devstack sudo[89965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09.7b1d5be9-ab5d-4d93-aa5f-504aa1ea5c20 Apr 24 13:55:22 devstack sudo[89965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:22 devstack sudo[89965]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09.7b1d5be9-ab5d-4d93-aa5f-504aa1ea5c20" returned: 0 in 0.609s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:22 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e8a06a4-370b-45b1-a851-b76c5a364e09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:55:22 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09 {{(pid=82046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 13:55:22 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Creating direct copy from snapshot {{(pid=82046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 13:55:22 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed77e274-300a-46a5-a88c-362a210c7dd9]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:55:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:22 devstack sudo[89970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09 Apr 24 13:55:22 devstack sudo[89970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:23 devstack sudo[89970]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:23 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09" returned: 0 in 0.627s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:23 devstack cinder-volume[82046]: DEBUG cinder.utils [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Path /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d988efdc-beb9-4965-a2c9-714b5f35b9e0 not found in is_blk_device check {{(pid=82046) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 13:55:23 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d988efdc-beb9-4965-a2c9-714b5f35b9e0 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:23 devstack sudo[89975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d988efdc-beb9-4965-a2c9-714b5f35b9e0 Apr 24 13:55:23 devstack sudo[89975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:28 devstack sudo[89975]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d988efdc-beb9-4965-a2c9-714b5f35b9e0" returned: 0 in 4.773s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:28 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[745e76d1-6912-4765-93c4-1a2caedd520c]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:55:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:28 devstack sudo[89988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09 Apr 24 13:55:28 devstack sudo[89988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:28 devstack sudo[89988]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09" returned: 0 in 0.648s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:28 devstack cinder-volume[82046]: DEBUG cinder.image.image_utils [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Image conversion details: src /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09, size 1024.00 MB, duration 4.77 sec, destination /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d988efdc-beb9-4965-a2c9-714b5f35b9e0 {{(pid=82046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 13:55:28 devstack cinder-volume[82046]: INFO cinder.image.image_utils [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Converted 1024.00 MB image at 214.47 MB/s Apr 24 13:55:28 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d988efdc-beb9-4965-a2c9-714b5f35b9e0 is being set with open permissions: ugo+rw Apr 24 13:55:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d988efdc-beb9-4965-a2c9-714b5f35b9e0 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:28 devstack sudo[89993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d988efdc-beb9-4965-a2c9-714b5f35b9e0 Apr 24 13:55:28 devstack sudo[89993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:29 devstack sudo[89993]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d988efdc-beb9-4965-a2c9-714b5f35b9e0" returned: 0 in 0.438s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:29 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Lock "cinder-quobyte-d988efdc-beb9-4965-a2c9-714b5f35b9e0" released by "_copy_volume_from_snapshot" :: held 7.180s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:55:29 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Acquiring lock "cinder-quobyte-7b1d5be9-ab5d-4d93-aa5f-504aa1ea5c20" by "_delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:55:29 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Lock "cinder-quobyte-7b1d5be9-ab5d-4d93-aa5f-504aa1ea5c20" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:55:29 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Deleting offline snapshot 7b1d5be9-ab5d-4d93-aa5f-504aa1ea5c20 of volume 7e8a06a4-370b-45b1-a851-b76c5a364e09 {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 13:55:29 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] snapshot_file for this snap is: volume-7e8a06a4-370b-45b1-a851-b76c5a364e09.7b1d5be9-ab5d-4d93-aa5f-504aa1ea5c20 {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 13:55:29 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d531c3a-72aa-4e75-b959-e8ee79a54a5b]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:55:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09.7b1d5be9-ab5d-4d93-aa5f-504aa1ea5c20 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:29 devstack sudo[89996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09.7b1d5be9-ab5d-4d93-aa5f-504aa1ea5c20 Apr 24 13:55:29 devstack sudo[89996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:29 devstack sudo[89996]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09.7b1d5be9-ab5d-4d93-aa5f-504aa1ea5c20" returned: 0 in 0.531s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:29 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e8a06a4-370b-45b1-a851-b76c5a364e09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:55:29 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a463924-441f-4dc6-9c75-63ad1fcfd68a]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:55:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:30 devstack sudo[90001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09 Apr 24 13:55:30 devstack sudo[90001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:30 devstack sudo[90001]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09" returned: 0 in 0.510s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09.7b1d5be9-ab5d-4d93-aa5f-504aa1ea5c20 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:30 devstack sudo[90006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09.7b1d5be9-ab5d-4d93-aa5f-504aa1ea5c20 Apr 24 13:55:30 devstack sudo[90006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:31 devstack sudo[90006]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09.7b1d5be9-ab5d-4d93-aa5f-504aa1ea5c20" returned: 0 in 0.544s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09.7b1d5be9-ab5d-4d93-aa5f-504aa1ea5c20 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:31 devstack sudo[90011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09.7b1d5be9-ab5d-4d93-aa5f-504aa1ea5c20 Apr 24 13:55:31 devstack sudo[90011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:31 devstack cinder-volume[82046]: DEBUG dbcounter [-] [82046] Writing DB stats cinder:SELECT=28,cinder:INSERT=10,cinder:UPDATE=28,cinder:DELETE=3 {{(pid=82046) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 13:55:31 devstack sudo[90011]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09.7b1d5be9-ab5d-4d93-aa5f-504aa1ea5c20" returned: 0 in 0.483s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:31 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Lock "cinder-quobyte-7b1d5be9-ab5d-4d93-aa5f-504aa1ea5c20" released by "_delete_snapshot" :: held 2.166s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:55:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.735s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:55:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6077f10b-ad3a-4502-b87a-e2f74d27c6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d988efdc-beb9-4965-a2c9-714b5f35b9e0', 'volume_size': 1, 'source_volid': '7e8a06a4-370b-45b1-a851-b76c5a364e09', 'source_volstatus': 'available'}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:55:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a81c8d-9879-4bc0-bb45-e0436e2ceb26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:55:31 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Volume volume-d988efdc-beb9-4965-a2c9-714b5f35b9e0 (d988efdc-beb9-4965-a2c9-714b5f35b9e0): created successfully Apr 24 13:55:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a81c8d-9879-4bc0-bb45-e0436e2ceb26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:55:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Flow 'volume_create_manager' (aa806671-1baf-4378-a9df-26bb97b91fcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:55:31 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-4a07c877-285c-4184-ba09-c212b62f21bc tempest-VolumesGetTest-1964773963 None] Created volume successfully. Apr 24 13:55:33 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c170776-3b66-49f0-aeda-877ec81adb5c tempest-VolumesGetTest-1964773963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:55:33 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6c170776-3b66-49f0-aeda-877ec81adb5c tempest-VolumesGetTest-1964773963 None] Flow 'volume_create_manager' (7889a60b-dee2-4027-abe1-54403bfb1b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:55:33 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6c170776-3b66-49f0-aeda-877ec81adb5c tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e46fd499-192d-45e1-8f8c-393c535f046d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:55:33 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6c170776-3b66-49f0-aeda-877ec81adb5c tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e46fd499-192d-45e1-8f8c-393c535f046d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:55:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-277001169',display_name='tempest-VolumesGetTest-Volume-1450886303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=555abd25-a810-443e-9b87-fc84c2f730e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ea76121a590498e8b5cdcb0702af588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:55:33Z,use_quota=True,user_id='cf706cc8f3ea45e4abcce32a1d1ce12d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:55:33 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6c170776-3b66-49f0-aeda-877ec81adb5c tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f0cd46d-01b2-4b01-a7b6-dac332192b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:55:33 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6c170776-3b66-49f0-aeda-877ec81adb5c tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f0cd46d-01b2-4b01-a7b6-dac332192b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:55:33 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6c170776-3b66-49f0-aeda-877ec81adb5c tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21283064-8039-4d9f-b93c-ac3330f62404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:55:33 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6c170776-3b66-49f0-aeda-877ec81adb5c tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21283064-8039-4d9f-b93c-ac3330f62404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '555abd25-a810-443e-9b87-fc84c2f730e1', 'volume_name': 'volume-555abd25-a810-443e-9b87-fc84c2f730e1', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:55:33 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6c170776-3b66-49f0-aeda-877ec81adb5c tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e642b0a-09a1-4862-888e-131c4b5b7c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:55:33 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6c170776-3b66-49f0-aeda-877ec81adb5c tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e642b0a-09a1-4862-888e-131c4b5b7c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:55:33 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6c170776-3b66-49f0-aeda-877ec81adb5c tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c29bea6-fc1e-4c49-89e7-d42e4e8fd3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:55:33 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-6c170776-3b66-49f0-aeda-877ec81adb5c tempest-VolumesGetTest-1964773963 None] Volume 555abd25-a810-443e-9b87-fc84c2f730e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-555abd25-a810-443e-9b87-fc84c2f730e1', 'volume_size': 1} Apr 24 13:55:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-6c170776-3b66-49f0-aeda-877ec81adb5c tempest-VolumesGetTest-1964773963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:55:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-6c170776-3b66-49f0-aeda-877ec81adb5c tempest-VolumesGetTest-1964773963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:55:33 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-6c170776-3b66-49f0-aeda-877ec81adb5c tempest-VolumesGetTest-1964773963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:55:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-277001169',display_name='tempest-VolumesGetTest-Volume-1450886303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=555abd25-a810-443e-9b87-fc84c2f730e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ea76121a590498e8b5cdcb0702af588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:55:33Z,use_quota=True,user_id='cf706cc8f3ea45e4abcce32a1d1ce12d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:55:33 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-6c170776-3b66-49f0-aeda-877ec81adb5c tempest-VolumesGetTest-1964773963 None] Creating volume 555abd25-a810-443e-9b87-fc84c2f730e1 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:55:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-6c170776-3b66-49f0-aeda-877ec81adb5c tempest-VolumesGetTest-1964773963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:55:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-6c170776-3b66-49f0-aeda-877ec81adb5c tempest-VolumesGetTest-1964773963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:55:33 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-6c170776-3b66-49f0-aeda-877ec81adb5c tempest-VolumesGetTest-1964773963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:55:33 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-6c170776-3b66-49f0-aeda-877ec81adb5c tempest-VolumesGetTest-1964773963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:55:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-6c170776-3b66-49f0-aeda-877ec81adb5c tempest-VolumesGetTest-1964773963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:55:33 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-6c170776-3b66-49f0-aeda-877ec81adb5c tempest-VolumesGetTest-1964773963 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:55:33 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-6c170776-3b66-49f0-aeda-877ec81adb5c tempest-VolumesGetTest-1964773963 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:55:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6c170776-3b66-49f0-aeda-877ec81adb5c tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-555abd25-a810-443e-9b87-fc84c2f730e1 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:33 devstack sudo[90016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-555abd25-a810-443e-9b87-fc84c2f730e1 1073741824 Apr 24 13:55:33 devstack sudo[90016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:34 devstack sudo[90016]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6c170776-3b66-49f0-aeda-877ec81adb5c tempest-VolumesGetTest-1964773963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-555abd25-a810-443e-9b87-fc84c2f730e1 1073741824" returned: 0 in 0.694s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6c170776-3b66-49f0-aeda-877ec81adb5c tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-555abd25-a810-443e-9b87-fc84c2f730e1 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:34 devstack sudo[90021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-555abd25-a810-443e-9b87-fc84c2f730e1 Apr 24 13:55:34 devstack sudo[90021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:34 devstack sudo[90021]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6c170776-3b66-49f0-aeda-877ec81adb5c tempest-VolumesGetTest-1964773963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-555abd25-a810-443e-9b87-fc84c2f730e1" returned: 0 in 0.477s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:34 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-6c170776-3b66-49f0-aeda-877ec81adb5c tempest-VolumesGetTest-1964773963 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:55:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-6c170776-3b66-49f0-aeda-877ec81adb5c tempest-VolumesGetTest-1964773963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.222s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:55:34 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6c170776-3b66-49f0-aeda-877ec81adb5c tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c29bea6-fc1e-4c49-89e7-d42e4e8fd3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-555abd25-a810-443e-9b87-fc84c2f730e1', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:55:34 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6c170776-3b66-49f0-aeda-877ec81adb5c tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef9b6cd9-a164-4258-ab62-d5652fa68ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:55:34 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-6c170776-3b66-49f0-aeda-877ec81adb5c tempest-VolumesGetTest-1964773963 None] Volume volume-555abd25-a810-443e-9b87-fc84c2f730e1 (555abd25-a810-443e-9b87-fc84c2f730e1): created successfully Apr 24 13:55:34 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6c170776-3b66-49f0-aeda-877ec81adb5c tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef9b6cd9-a164-4258-ab62-d5652fa68ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:55:34 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6c170776-3b66-49f0-aeda-877ec81adb5c tempest-VolumesGetTest-1964773963 None] Flow 'volume_create_manager' (7889a60b-dee2-4027-abe1-54403bfb1b24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:55:34 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-6c170776-3b66-49f0-aeda-877ec81adb5c tempest-VolumesGetTest-1964773963 None] Created volume successfully. Apr 24 13:55:35 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-c1264880-ee12-4158-90f6-22a67d50dc35 tempest-VolumesGetTest-1964773963 None] Acquiring lock "cinder-555abd25-a810-443e-9b87-fc84c2f730e1-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:55:35 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-c1264880-ee12-4158-90f6-22a67d50dc35 tempest-VolumesGetTest-1964773963 None] Lock "cinder-555abd25-a810-443e-9b87-fc84c2f730e1-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:55:35 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-c1264880-ee12-4158-90f6-22a67d50dc35 tempest-VolumesGetTest-1964773963 None] Acquiring lock "cinder-quobyte-555abd25-a810-443e-9b87-fc84c2f730e1" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:55:35 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-c1264880-ee12-4158-90f6-22a67d50dc35 tempest-VolumesGetTest-1964773963 None] Lock "cinder-quobyte-555abd25-a810-443e-9b87-fc84c2f730e1" acquired by "delete_volume" :: waited 0.020s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:55:35 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bbf105c-9699-4d24-898e-717d031184ee]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:55:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-c1264880-ee12-4158-90f6-22a67d50dc35 tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-555abd25-a810-443e-9b87-fc84c2f730e1 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:35 devstack sudo[90025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-555abd25-a810-443e-9b87-fc84c2f730e1 Apr 24 13:55:35 devstack sudo[90025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:36 devstack sudo[90025]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-c1264880-ee12-4158-90f6-22a67d50dc35 tempest-VolumesGetTest-1964773963 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-555abd25-a810-443e-9b87-fc84c2f730e1" returned: 0 in 0.540s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-c1264880-ee12-4158-90f6-22a67d50dc35 tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-555abd25-a810-443e-9b87-fc84c2f730e1 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:36 devstack sudo[90030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-555abd25-a810-443e-9b87-fc84c2f730e1 Apr 24 13:55:36 devstack sudo[90030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:36 devstack sudo[90030]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-c1264880-ee12-4158-90f6-22a67d50dc35 tempest-VolumesGetTest-1964773963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-555abd25-a810-443e-9b87-fc84c2f730e1" returned: 0 in 0.468s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:36 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-c1264880-ee12-4158-90f6-22a67d50dc35 tempest-VolumesGetTest-1964773963 None] Lock "cinder-quobyte-555abd25-a810-443e-9b87-fc84c2f730e1" released by "delete_volume" :: held 1.055s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:55:36 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-c1264880-ee12-4158-90f6-22a67d50dc35 tempest-VolumesGetTest-1964773963 None] Created reservations ['b9524038-3c50-4b97-ad31-5f7dd1abb709', '45d62524-5984-4b71-8c9a-1be55a567063', '92b8e4c0-2aa5-4317-9416-d825771586e1', '8fd82320-9dde-4b18-b036-4bbb92f9d6bc'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:55:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-c1264880-ee12-4158-90f6-22a67d50dc35 tempest-VolumesGetTest-1964773963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:55:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-c1264880-ee12-4158-90f6-22a67d50dc35 tempest-VolumesGetTest-1964773963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:55:36 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-c1264880-ee12-4158-90f6-22a67d50dc35 tempest-VolumesGetTest-1964773963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:55:36 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-c1264880-ee12-4158-90f6-22a67d50dc35 tempest-VolumesGetTest-1964773963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:55:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-c1264880-ee12-4158-90f6-22a67d50dc35 tempest-VolumesGetTest-1964773963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:55:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-c1264880-ee12-4158-90f6-22a67d50dc35 tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:36 devstack sudo[90033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:55:36 devstack sudo[90033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:37 devstack sudo[90033]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-c1264880-ee12-4158-90f6-22a67d50dc35 tempest-VolumesGetTest-1964773963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.454s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:37 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-c1264880-ee12-4158-90f6-22a67d50dc35 tempest-VolumesGetTest-1964773963 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:55:37 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-c1264880-ee12-4158-90f6-22a67d50dc35 tempest-VolumesGetTest-1964773963 None] Deleted volume successfully. Apr 24 13:55:37 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-c1264880-ee12-4158-90f6-22a67d50dc35 tempest-VolumesGetTest-1964773963 None] Lock "cinder-555abd25-a810-443e-9b87-fc84c2f730e1-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:55:37 devstack cinder-volume[82046]: DEBUG oslo_service.periodic_task [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82046) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 13:55:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:55:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:55:37 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:55:37 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:55:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:55:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:37 devstack sudo[90036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:55:37 devstack sudo[90036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:37 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-36d7c4fc-f9a3-4b83-8504-c8a7669a7807 tempest-VolumesGetTest-1964773963 None] Acquiring lock "cinder-d988efdc-beb9-4965-a2c9-714b5f35b9e0-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:55:38 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-36d7c4fc-f9a3-4b83-8504-c8a7669a7807 tempest-VolumesGetTest-1964773963 None] Lock "cinder-d988efdc-beb9-4965-a2c9-714b5f35b9e0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:55:38 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-36d7c4fc-f9a3-4b83-8504-c8a7669a7807 tempest-VolumesGetTest-1964773963 None] Acquiring lock "cinder-quobyte-d988efdc-beb9-4965-a2c9-714b5f35b9e0" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:55:38 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-36d7c4fc-f9a3-4b83-8504-c8a7669a7807 tempest-VolumesGetTest-1964773963 None] Lock "cinder-quobyte-d988efdc-beb9-4965-a2c9-714b5f35b9e0" acquired by "delete_volume" :: waited 0.021s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:55:38 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6367f3d-ac67-4409-81c8-adc726c3f2fe]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:55:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-36d7c4fc-f9a3-4b83-8504-c8a7669a7807 tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d988efdc-beb9-4965-a2c9-714b5f35b9e0 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:38 devstack sudo[90038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d988efdc-beb9-4965-a2c9-714b5f35b9e0 Apr 24 13:55:38 devstack sudo[90038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:38 devstack sudo[90036]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.556s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:38 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:55:38 devstack sudo[90038]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-36d7c4fc-f9a3-4b83-8504-c8a7669a7807 tempest-VolumesGetTest-1964773963 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d988efdc-beb9-4965-a2c9-714b5f35b9e0" returned: 0 in 0.619s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-36d7c4fc-f9a3-4b83-8504-c8a7669a7807 tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d988efdc-beb9-4965-a2c9-714b5f35b9e0 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:38 devstack sudo[90045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d988efdc-beb9-4965-a2c9-714b5f35b9e0 Apr 24 13:55:38 devstack sudo[90045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:39 devstack sudo[90045]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-36d7c4fc-f9a3-4b83-8504-c8a7669a7807 tempest-VolumesGetTest-1964773963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d988efdc-beb9-4965-a2c9-714b5f35b9e0" returned: 0 in 0.505s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:39 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-36d7c4fc-f9a3-4b83-8504-c8a7669a7807 tempest-VolumesGetTest-1964773963 None] Lock "cinder-quobyte-d988efdc-beb9-4965-a2c9-714b5f35b9e0" released by "delete_volume" :: held 1.168s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:55:39 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-36d7c4fc-f9a3-4b83-8504-c8a7669a7807 tempest-VolumesGetTest-1964773963 None] Created reservations ['7cfdf727-d59d-4db8-a53a-0e62ace070dc', 'a17694f9-c079-4dbc-b47f-6c0a4414e1a6', 'e32b9356-2d57-4d54-b17f-78c216e5000d', '854d1dee-ac6d-42e7-9f7c-9850f3ba79c6'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:55:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-36d7c4fc-f9a3-4b83-8504-c8a7669a7807 tempest-VolumesGetTest-1964773963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:55:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-36d7c4fc-f9a3-4b83-8504-c8a7669a7807 tempest-VolumesGetTest-1964773963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:55:39 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-36d7c4fc-f9a3-4b83-8504-c8a7669a7807 tempest-VolumesGetTest-1964773963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:55:39 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-36d7c4fc-f9a3-4b83-8504-c8a7669a7807 tempest-VolumesGetTest-1964773963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:55:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-36d7c4fc-f9a3-4b83-8504-c8a7669a7807 tempest-VolumesGetTest-1964773963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:55:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-36d7c4fc-f9a3-4b83-8504-c8a7669a7807 tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:39 devstack sudo[90048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:55:39 devstack sudo[90048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:39 devstack sudo[90048]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-36d7c4fc-f9a3-4b83-8504-c8a7669a7807 tempest-VolumesGetTest-1964773963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.460s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:39 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-36d7c4fc-f9a3-4b83-8504-c8a7669a7807 tempest-VolumesGetTest-1964773963 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:55:39 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-36d7c4fc-f9a3-4b83-8504-c8a7669a7807 tempest-VolumesGetTest-1964773963 None] Deleted volume successfully. Apr 24 13:55:39 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-36d7c4fc-f9a3-4b83-8504-c8a7669a7807 tempest-VolumesGetTest-1964773963 None] Lock "cinder-d988efdc-beb9-4965-a2c9-714b5f35b9e0-delete_volume" released by "delete_volume" :: held 1.852s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:55:40 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-54b09f61-0b15-4944-b8f1-d47e6f07ae98 tempest-VolumesGetTest-1964773963 None] Acquiring lock "cinder-7e8a06a4-370b-45b1-a851-b76c5a364e09-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:55:40 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-54b09f61-0b15-4944-b8f1-d47e6f07ae98 tempest-VolumesGetTest-1964773963 None] Lock "cinder-7e8a06a4-370b-45b1-a851-b76c5a364e09-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:55:40 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-54b09f61-0b15-4944-b8f1-d47e6f07ae98 tempest-VolumesGetTest-1964773963 None] Acquiring lock "cinder-quobyte-7e8a06a4-370b-45b1-a851-b76c5a364e09" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:55:40 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-54b09f61-0b15-4944-b8f1-d47e6f07ae98 tempest-VolumesGetTest-1964773963 None] Lock "cinder-quobyte-7e8a06a4-370b-45b1-a851-b76c5a364e09" acquired by "delete_volume" :: waited 0.017s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:55:40 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1695fda-f0d9-479f-b6b1-3c19b2b16698]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:55:40 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-54b09f61-0b15-4944-b8f1-d47e6f07ae98 tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:40 devstack sudo[90051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09 Apr 24 13:55:40 devstack sudo[90051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:41 devstack sudo[90051]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-54b09f61-0b15-4944-b8f1-d47e6f07ae98 tempest-VolumesGetTest-1964773963 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09" returned: 0 in 0.641s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-54b09f61-0b15-4944-b8f1-d47e6f07ae98 tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:41 devstack sudo[90056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09 Apr 24 13:55:41 devstack sudo[90056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:41 devstack sudo[90056]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-54b09f61-0b15-4944-b8f1-d47e6f07ae98 tempest-VolumesGetTest-1964773963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7e8a06a4-370b-45b1-a851-b76c5a364e09" returned: 0 in 0.470s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:41 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-54b09f61-0b15-4944-b8f1-d47e6f07ae98 tempest-VolumesGetTest-1964773963 None] Lock "cinder-quobyte-7e8a06a4-370b-45b1-a851-b76c5a364e09" released by "delete_volume" :: held 1.178s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:55:41 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-54b09f61-0b15-4944-b8f1-d47e6f07ae98 tempest-VolumesGetTest-1964773963 None] Created reservations ['810541c9-05d9-42d8-a05e-bb5759406340', '723cfadf-1cb5-4730-9d7d-add2e98f61e7', '40d1a36d-574c-42ce-93f1-7d936ec548f1', 'e2c1416d-c0ce-420e-9a70-1217757d1523'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:55:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-54b09f61-0b15-4944-b8f1-d47e6f07ae98 tempest-VolumesGetTest-1964773963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:55:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-54b09f61-0b15-4944-b8f1-d47e6f07ae98 tempest-VolumesGetTest-1964773963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:55:41 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-54b09f61-0b15-4944-b8f1-d47e6f07ae98 tempest-VolumesGetTest-1964773963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:55:41 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-54b09f61-0b15-4944-b8f1-d47e6f07ae98 tempest-VolumesGetTest-1964773963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:55:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-54b09f61-0b15-4944-b8f1-d47e6f07ae98 tempest-VolumesGetTest-1964773963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:55:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-54b09f61-0b15-4944-b8f1-d47e6f07ae98 tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:41 devstack sudo[90059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:55:41 devstack sudo[90059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:42 devstack sudo[90059]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:42 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-54b09f61-0b15-4944-b8f1-d47e6f07ae98 tempest-VolumesGetTest-1964773963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.441s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:42 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-54b09f61-0b15-4944-b8f1-d47e6f07ae98 tempest-VolumesGetTest-1964773963 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:55:42 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-54b09f61-0b15-4944-b8f1-d47e6f07ae98 tempest-VolumesGetTest-1964773963 None] Deleted volume successfully. Apr 24 13:55:42 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-54b09f61-0b15-4944-b8f1-d47e6f07ae98 tempest-VolumesGetTest-1964773963 None] Lock "cinder-7e8a06a4-370b-45b1-a851-b76c5a364e09-delete_volume" released by "delete_volume" :: held 1.836s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:55:43 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:55:43 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] Flow 'volume_create_manager' (30a120a2-4f54-4036-890d-502b94e2de6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:55:43 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9d52de0-8c2c-4259-850d-5ad35e188a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:55:43 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9d52de0-8c2c-4259-850d-5ad35e188a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1204080096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdd5c2d5-b3ad-4591-b3c8-238eabf46303,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1ea76121a590498e8b5cdcb0702af588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:55:43Z,use_quota=True,user_id='cf706cc8f3ea45e4abcce32a1d1ce12d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:55:43 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c542068f-400e-4e84-9cdd-953befc96844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:55:43 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c542068f-400e-4e84-9cdd-953befc96844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:55:43 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8835992d-d337-428d-b229-9c0780020510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:55:43 devstack cinder-volume[82046]: DEBUG cinder.image.glance [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] Creating Keystone auth plugin from conf {{(pid=82046) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 24 13:55:43 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8835992d-d337-428d-b229-9c0780020510) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bdd5c2d5-b3ad-4591-b3c8-238eabf46303', 'volume_name': 'volume-bdd5c2d5-b3ad-4591-b3c8-238eabf46303', 'volume_size': 1, 'image_id': '02b8aec0-dc1c-4b93-81c4-ab6b88d472d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02b8aec0-dc1c-4b93-81c4-ab6b88d472d9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db6d5b1c41254596bd8bad1e5f7bec28', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02b8aec0-dc1c-4b93-81c4-ab6b88d472d9', 'created_at': datetime.datetime(2026, 4, 24, 11, 39, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 11, 39, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02b8aec0-dc1c-4b93-81c4-ab6b88d472d9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:55:43 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6afd0061-360d-43a7-84c2-84ac36d59bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:55:43 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6afd0061-360d-43a7-84c2-84ac36d59bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:55:43 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09ac530d-fae0-4c6d-8cc5-c68019603c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:55:43 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] Volume bdd5c2d5-b3ad-4591-b3c8-238eabf46303: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bdd5c2d5-b3ad-4591-b3c8-238eabf46303', 'volume_size': 1, 'image_id': '02b8aec0-dc1c-4b93-81c4-ab6b88d472d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02b8aec0-dc1c-4b93-81c4-ab6b88d472d9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db6d5b1c41254596bd8bad1e5f7bec28', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02b8aec0-dc1c-4b93-81c4-ab6b88d472d9', 'created_at': datetime.datetime(2026, 4, 24, 11, 39, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 11, 39, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02b8aec0-dc1c-4b93-81c4-ab6b88d472d9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 24 13:55:43 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] Trying to clone bdd5c2d5-b3ad-4591-b3c8-238eabf46303 from image 02b8aec0-dc1c-4b93-81c4-ab6b88d472d9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/02b8aec0-dc1c-4b93-81c4-ab6b88d472d9', 'metadata': {}}]). {{(pid=82046) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 24 13:55:43 devstack cinder-volume[82046]: DEBUG cinder.image.image_utils [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_4pydj_0mdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82046) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 24 13:55:43 devstack cinder-volume[82046]: INFO cinder.image.image_utils [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] Image download 20.69 MB at 20.69 MB/s Apr 24 13:55:43 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d15e75e-e3f6-4ff6-abc9-247a2a24f69d]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:55:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_4pydj_0mdevstack@QuobyteHD {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:44 devstack sudo[90063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_4pydj_0mdevstack@QuobyteHD Apr 24 13:55:44 devstack sudo[90063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:44 devstack sudo[90063]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_4pydj_0mdevstack@QuobyteHD" returned: 0 in 0.516s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:44 devstack cinder-volume[82046]: DEBUG cinder.image.image_utils [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] Temporary image 02b8aec0-dc1c-4b93-81c4-ab6b88d472d9 is fetched for user cf706cc8f3ea45e4abcce32a1d1ce12d. {{(pid=82046) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 24 13:55:44 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9d04e4-a434-4c22-819b-550f6e75eff2]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:55:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_4pydj_0mdevstack@QuobyteHD {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:44 devstack sudo[90068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_4pydj_0mdevstack@QuobyteHD Apr 24 13:55:44 devstack sudo[90068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:45 devstack sudo[90068]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_4pydj_0mdevstack@QuobyteHD" returned: 0 in 0.503s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:55:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:55:45 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1204080096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdd5c2d5-b3ad-4591-b3c8-238eabf46303,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1ea76121a590498e8b5cdcb0702af588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:55:43Z,use_quota=True,user_id='cf706cc8f3ea45e4abcce32a1d1ce12d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:55:45 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] Creating volume bdd5c2d5-b3ad-4591-b3c8-238eabf46303 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:55:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:55:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:55:45 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:55:45 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:55:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:55:45 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:55:45 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:55:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bdd5c2d5-b3ad-4591-b3c8-238eabf46303 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:45 devstack sudo[90073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bdd5c2d5-b3ad-4591-b3c8-238eabf46303 1073741824 Apr 24 13:55:45 devstack sudo[90073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:45 devstack sudo[90073]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bdd5c2d5-b3ad-4591-b3c8-238eabf46303 1073741824" returned: 0 in 0.615s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bdd5c2d5-b3ad-4591-b3c8-238eabf46303 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:45 devstack sudo[90079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bdd5c2d5-b3ad-4591-b3c8-238eabf46303 Apr 24 13:55:45 devstack sudo[90079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:46 devstack sudo[90079]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:46 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bdd5c2d5-b3ad-4591-b3c8-238eabf46303" returned: 0 in 0.443s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:46 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:55:46 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:55:46 devstack cinder-volume[82046]: DEBUG cinder.volume.volume_utils [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] Attempting download of 02b8aec0-dc1c-4b93-81c4-ab6b88d472d9 ((None, [{'url': 'file:///opt/stack/data/glance/images/02b8aec0-dc1c-4b93-81c4-ab6b88d472d9', 'metadata': {}}])) to volume bdd5c2d5-b3ad-4591-b3c8-238eabf46303. {{(pid=82046) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 24 13:55:46 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67b3b8c-d875-4f3b-876a-11e659822337]: (4, 'raw') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:55:46 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_yv2ho4oi {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:46 devstack sudo[90082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_yv2ho4oi Apr 24 13:55:46 devstack sudo[90082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:46 devstack sudo[90082]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:46 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_yv2ho4oi" returned: 0 in 0.514s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:46 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_yv2ho4oi {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:46 devstack sudo[90086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_yv2ho4oi Apr 24 13:55:46 devstack sudo[90086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:47 devstack sudo[90086]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_yv2ho4oi" returned: 1 in 0.480s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_yv2ho4oi' failed. Not Retrying. {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 13:55:47 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[2893e6e5-8d4d-4646-9c27-da3600337402]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:55:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_4pydj_0mdevstack@QuobyteHD {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:47 devstack sudo[90090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_4pydj_0mdevstack@QuobyteHD Apr 24 13:55:47 devstack sudo[90090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:47 devstack sudo[90090]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_4pydj_0mdevstack@QuobyteHD" returned: 0 in 0.516s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:47 devstack cinder-volume[82046]: DEBUG cinder.image.image_utils [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] 02b8aec0-dc1c-4b93-81c4-ab6b88d472d9 was qcow2, converting to raw {{(pid=82046) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 24 13:55:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_4pydj_0mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bdd5c2d5-b3ad-4591-b3c8-238eabf46303 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:47 devstack sudo[90095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_4pydj_0mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bdd5c2d5-b3ad-4591-b3c8-238eabf46303 Apr 24 13:55:47 devstack sudo[90095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:49 devstack sudo[90095]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_4pydj_0mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bdd5c2d5-b3ad-4591-b3c8-238eabf46303" returned: 0 in 1.289s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:49 devstack cinder-volume[82046]: DEBUG cinder.image.image_utils [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_02b8aec0-dc1c-4b93-81c4-ab6b88d472d9_4pydj_0mdevstack@QuobyteHD, size 112.00 MB, duration 1.29 sec, destination /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bdd5c2d5-b3ad-4591-b3c8-238eabf46303 {{(pid=82046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 13:55:49 devstack cinder-volume[82046]: INFO cinder.image.image_utils [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] Converted 112.00 MB image at 86.78 MB/s Apr 24 13:55:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bdd5c2d5-b3ad-4591-b3c8-238eabf46303 1G {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:49 devstack sudo[90107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bdd5c2d5-b3ad-4591-b3c8-238eabf46303 1G Apr 24 13:55:49 devstack sudo[90107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:49 devstack sudo[90107]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bdd5c2d5-b3ad-4591-b3c8-238eabf46303 1G" returned: 0 in 0.493s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:49 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61f9ee8-831c-4af3-bdf7-6370bd8ebae0]: (4, 'raw') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:55:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bdd5c2d5-b3ad-4591-b3c8-238eabf46303 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:49 devstack sudo[90112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bdd5c2d5-b3ad-4591-b3c8-238eabf46303 Apr 24 13:55:49 devstack sudo[90112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:50 devstack sudo[90112]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bdd5c2d5-b3ad-4591-b3c8-238eabf46303" returned: 0 in 0.512s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bdd5c2d5-b3ad-4591-b3c8-238eabf46303 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:50 devstack sudo[90122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bdd5c2d5-b3ad-4591-b3c8-238eabf46303 Apr 24 13:55:50 devstack sudo[90122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:50 devstack sudo[90122]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bdd5c2d5-b3ad-4591-b3c8-238eabf46303" returned: 1 in 0.514s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bdd5c2d5-b3ad-4591-b3c8-238eabf46303' failed. Not Retrying. {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 13:55:50 devstack cinder-volume[82046]: DEBUG cinder.volume.volume_utils [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] Downloaded image 02b8aec0-dc1c-4b93-81c4-ab6b88d472d9 ((None, [{'url': 'file:///opt/stack/data/glance/images/02b8aec0-dc1c-4b93-81c4-ab6b88d472d9', 'metadata': {}}])) to volume bdd5c2d5-b3ad-4591-b3c8-238eabf46303 successfully. {{(pid=82046) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 24 13:55:50 devstack cinder-volume[82046]: DEBUG cinder.image.image_utils [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] Temporary image 02b8aec0-dc1c-4b93-81c4-ab6b88d472d9 for user cf706cc8f3ea45e4abcce32a1d1ce12d is deleted. {{(pid=82046) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 24 13:55:50 devstack cinder-volume[82046]: DEBUG cinder.volume.volume_utils [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] Marking volume bdd5c2d5-b3ad-4591-b3c8-238eabf46303 as bootable. {{(pid=82046) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 24 13:55:50 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] Copying metadata from image 02b8aec0-dc1c-4b93-81c4-ab6b88d472d9 to bdd5c2d5-b3ad-4591-b3c8-238eabf46303. {{(pid=82046) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 24 13:55:50 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] Creating volume glance metadata for volume bdd5c2d5-b3ad-4591-b3c8-238eabf46303 backed by image 02b8aec0-dc1c-4b93-81c4-ab6b88d472d9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '02b8aec0-dc1c-4b93-81c4-ab6b88d472d9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82046) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 24 13:55:50 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09ac530d-fae0-4c6d-8cc5-c68019603c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdd5c2d5-b3ad-4591-b3c8-238eabf46303', 'volume_size': 1, 'image_id': '02b8aec0-dc1c-4b93-81c4-ab6b88d472d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02b8aec0-dc1c-4b93-81c4-ab6b88d472d9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db6d5b1c41254596bd8bad1e5f7bec28', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '02b8aec0-dc1c-4b93-81c4-ab6b88d472d9', 'created_at': datetime.datetime(2026, 4, 24, 11, 39, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 24, 11, 39, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02b8aec0-dc1c-4b93-81c4-ab6b88d472d9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:55:50 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2cd2f28-b78d-4f54-8d2e-1f364899d5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:55:50 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] Volume volume-bdd5c2d5-b3ad-4591-b3c8-238eabf46303 (bdd5c2d5-b3ad-4591-b3c8-238eabf46303): created successfully Apr 24 13:55:50 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2cd2f28-b78d-4f54-8d2e-1f364899d5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:55:50 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] Flow 'volume_create_manager' (30a120a2-4f54-4036-890d-502b94e2de6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:55:50 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-eb58dc77-8640-44bc-b3fc-ee3c796286de tempest-VolumesGetTest-1964773963 None] Created volume successfully. Apr 24 13:55:52 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a97497e-c3a6-463c-8db3-14d2f61dc41e tempest-VolumesGetTest-1964773963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:55:52 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8a97497e-c3a6-463c-8db3-14d2f61dc41e tempest-VolumesGetTest-1964773963 None] Flow 'volume_create_manager' (baf3c3fb-0faf-488c-bc6b-3b3d280b1421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:55:52 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8a97497e-c3a6-463c-8db3-14d2f61dc41e tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (376c2cb8-cb9b-4b35-948b-ee6941d2ba24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:55:52 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8a97497e-c3a6-463c-8db3-14d2f61dc41e tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (376c2cb8-cb9b-4b35-948b-ee6941d2ba24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:55:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1993906771',display_name='tempest-VolumesGetTest-Volume-16209162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=764728a1-ee1d-4c69-9348-8c8de8e13995,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ea76121a590498e8b5cdcb0702af588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:55:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:55:52Z,use_quota=True,user_id='cf706cc8f3ea45e4abcce32a1d1ce12d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:55:52 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8a97497e-c3a6-463c-8db3-14d2f61dc41e tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f476f1e-2d7e-4298-b3da-9fec614d0a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:55:52 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8a97497e-c3a6-463c-8db3-14d2f61dc41e tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f476f1e-2d7e-4298-b3da-9fec614d0a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:55:52 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8a97497e-c3a6-463c-8db3-14d2f61dc41e tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3018c010-175e-440d-8fb0-b2d0080d04c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:55:52 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8a97497e-c3a6-463c-8db3-14d2f61dc41e tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3018c010-175e-440d-8fb0-b2d0080d04c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '764728a1-ee1d-4c69-9348-8c8de8e13995', 'volume_name': 'volume-764728a1-ee1d-4c69-9348-8c8de8e13995', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:55:52 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8a97497e-c3a6-463c-8db3-14d2f61dc41e tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0a1a02d-4663-4f2b-ac88-0cd6ceab0e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:55:52 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8a97497e-c3a6-463c-8db3-14d2f61dc41e tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0a1a02d-4663-4f2b-ac88-0cd6ceab0e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:55:52 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8a97497e-c3a6-463c-8db3-14d2f61dc41e tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45fa63eb-2a98-40c0-a341-32db62ec8961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:55:52 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-8a97497e-c3a6-463c-8db3-14d2f61dc41e tempest-VolumesGetTest-1964773963 None] Volume 764728a1-ee1d-4c69-9348-8c8de8e13995: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-764728a1-ee1d-4c69-9348-8c8de8e13995', 'volume_size': 1} Apr 24 13:55:52 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-8a97497e-c3a6-463c-8db3-14d2f61dc41e tempest-VolumesGetTest-1964773963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:55:52 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-8a97497e-c3a6-463c-8db3-14d2f61dc41e tempest-VolumesGetTest-1964773963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:55:52 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-8a97497e-c3a6-463c-8db3-14d2f61dc41e tempest-VolumesGetTest-1964773963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:55:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1993906771',display_name='tempest-VolumesGetTest-Volume-16209162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=764728a1-ee1d-4c69-9348-8c8de8e13995,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ea76121a590498e8b5cdcb0702af588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:55:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:55:52Z,use_quota=True,user_id='cf706cc8f3ea45e4abcce32a1d1ce12d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:55:52 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-8a97497e-c3a6-463c-8db3-14d2f61dc41e tempest-VolumesGetTest-1964773963 None] Creating volume 764728a1-ee1d-4c69-9348-8c8de8e13995 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:55:52 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-8a97497e-c3a6-463c-8db3-14d2f61dc41e tempest-VolumesGetTest-1964773963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:55:52 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-8a97497e-c3a6-463c-8db3-14d2f61dc41e tempest-VolumesGetTest-1964773963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:55:52 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-8a97497e-c3a6-463c-8db3-14d2f61dc41e tempest-VolumesGetTest-1964773963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:55:52 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-8a97497e-c3a6-463c-8db3-14d2f61dc41e tempest-VolumesGetTest-1964773963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:55:52 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-8a97497e-c3a6-463c-8db3-14d2f61dc41e tempest-VolumesGetTest-1964773963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:55:52 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-8a97497e-c3a6-463c-8db3-14d2f61dc41e tempest-VolumesGetTest-1964773963 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:55:52 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-8a97497e-c3a6-463c-8db3-14d2f61dc41e tempest-VolumesGetTest-1964773963 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:55:52 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8a97497e-c3a6-463c-8db3-14d2f61dc41e tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-764728a1-ee1d-4c69-9348-8c8de8e13995 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:52 devstack sudo[90127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-764728a1-ee1d-4c69-9348-8c8de8e13995 1073741824 Apr 24 13:55:52 devstack sudo[90127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:53 devstack sudo[90127]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8a97497e-c3a6-463c-8db3-14d2f61dc41e tempest-VolumesGetTest-1964773963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-764728a1-ee1d-4c69-9348-8c8de8e13995 1073741824" returned: 0 in 0.680s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8a97497e-c3a6-463c-8db3-14d2f61dc41e tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-764728a1-ee1d-4c69-9348-8c8de8e13995 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:53 devstack sudo[90132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-764728a1-ee1d-4c69-9348-8c8de8e13995 Apr 24 13:55:53 devstack sudo[90132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:53 devstack sudo[90132]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-8a97497e-c3a6-463c-8db3-14d2f61dc41e tempest-VolumesGetTest-1964773963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-764728a1-ee1d-4c69-9348-8c8de8e13995" returned: 0 in 0.480s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:53 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-8a97497e-c3a6-463c-8db3-14d2f61dc41e tempest-VolumesGetTest-1964773963 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:55:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-8a97497e-c3a6-463c-8db3-14d2f61dc41e tempest-VolumesGetTest-1964773963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:55:53 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8a97497e-c3a6-463c-8db3-14d2f61dc41e tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45fa63eb-2a98-40c0-a341-32db62ec8961) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-764728a1-ee1d-4c69-9348-8c8de8e13995', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:55:53 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8a97497e-c3a6-463c-8db3-14d2f61dc41e tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfbb3184-5696-46c9-9c4c-3c048800f312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:55:53 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-8a97497e-c3a6-463c-8db3-14d2f61dc41e tempest-VolumesGetTest-1964773963 None] Volume volume-764728a1-ee1d-4c69-9348-8c8de8e13995 (764728a1-ee1d-4c69-9348-8c8de8e13995): created successfully Apr 24 13:55:53 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8a97497e-c3a6-463c-8db3-14d2f61dc41e tempest-VolumesGetTest-1964773963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfbb3184-5696-46c9-9c4c-3c048800f312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:55:53 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-8a97497e-c3a6-463c-8db3-14d2f61dc41e tempest-VolumesGetTest-1964773963 None] Flow 'volume_create_manager' (baf3c3fb-0faf-488c-bc6b-3b3d280b1421) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:55:53 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-8a97497e-c3a6-463c-8db3-14d2f61dc41e tempest-VolumesGetTest-1964773963 None] Created volume successfully. Apr 24 13:55:54 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-44aecefd-ad20-4fe0-a333-0050d0e8fb84 tempest-VolumesGetTest-1964773963 None] Acquiring lock "cinder-764728a1-ee1d-4c69-9348-8c8de8e13995-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:55:54 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-44aecefd-ad20-4fe0-a333-0050d0e8fb84 tempest-VolumesGetTest-1964773963 None] Lock "cinder-764728a1-ee1d-4c69-9348-8c8de8e13995-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:55:54 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-44aecefd-ad20-4fe0-a333-0050d0e8fb84 tempest-VolumesGetTest-1964773963 None] Acquiring lock "cinder-quobyte-764728a1-ee1d-4c69-9348-8c8de8e13995" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:55:54 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-44aecefd-ad20-4fe0-a333-0050d0e8fb84 tempest-VolumesGetTest-1964773963 None] Lock "cinder-quobyte-764728a1-ee1d-4c69-9348-8c8de8e13995" acquired by "delete_volume" :: waited 0.018s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:55:54 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70d569d-9802-4497-b000-3675808f25e3]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:55:54 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-44aecefd-ad20-4fe0-a333-0050d0e8fb84 tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-764728a1-ee1d-4c69-9348-8c8de8e13995 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:54 devstack sudo[90135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-764728a1-ee1d-4c69-9348-8c8de8e13995 Apr 24 13:55:54 devstack sudo[90135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:55 devstack sudo[90135]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:55 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-44aecefd-ad20-4fe0-a333-0050d0e8fb84 tempest-VolumesGetTest-1964773963 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-764728a1-ee1d-4c69-9348-8c8de8e13995" returned: 0 in 0.547s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:55 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-44aecefd-ad20-4fe0-a333-0050d0e8fb84 tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-764728a1-ee1d-4c69-9348-8c8de8e13995 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:55 devstack sudo[90140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-764728a1-ee1d-4c69-9348-8c8de8e13995 Apr 24 13:55:55 devstack sudo[90140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:55 devstack sudo[90140]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:55 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-44aecefd-ad20-4fe0-a333-0050d0e8fb84 tempest-VolumesGetTest-1964773963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-764728a1-ee1d-4c69-9348-8c8de8e13995" returned: 0 in 0.469s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:55 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-44aecefd-ad20-4fe0-a333-0050d0e8fb84 tempest-VolumesGetTest-1964773963 None] Lock "cinder-quobyte-764728a1-ee1d-4c69-9348-8c8de8e13995" released by "delete_volume" :: held 1.061s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:55:55 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-44aecefd-ad20-4fe0-a333-0050d0e8fb84 tempest-VolumesGetTest-1964773963 None] Created reservations ['e4222265-aa25-43ae-bd7d-8b32f6a2caf7', '8be34c32-646a-4e2d-82aa-728d5b138625', '2e210705-cd63-4540-b8d5-c8bc353f3f96', '785b6f0b-cb40-4f9f-9301-50e74cc9f0bf'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:55:56 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-44aecefd-ad20-4fe0-a333-0050d0e8fb84 tempest-VolumesGetTest-1964773963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:55:56 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-44aecefd-ad20-4fe0-a333-0050d0e8fb84 tempest-VolumesGetTest-1964773963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:55:56 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-44aecefd-ad20-4fe0-a333-0050d0e8fb84 tempest-VolumesGetTest-1964773963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:55:56 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-44aecefd-ad20-4fe0-a333-0050d0e8fb84 tempest-VolumesGetTest-1964773963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:55:56 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-44aecefd-ad20-4fe0-a333-0050d0e8fb84 tempest-VolumesGetTest-1964773963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:55:56 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-44aecefd-ad20-4fe0-a333-0050d0e8fb84 tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:56 devstack sudo[90144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:55:56 devstack sudo[90144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:56 devstack sudo[90144]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:56 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-44aecefd-ad20-4fe0-a333-0050d0e8fb84 tempest-VolumesGetTest-1964773963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.477s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:56 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-44aecefd-ad20-4fe0-a333-0050d0e8fb84 tempest-VolumesGetTest-1964773963 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:55:56 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-44aecefd-ad20-4fe0-a333-0050d0e8fb84 tempest-VolumesGetTest-1964773963 None] Deleted volume successfully. Apr 24 13:55:56 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-44aecefd-ad20-4fe0-a333-0050d0e8fb84 tempest-VolumesGetTest-1964773963 None] Lock "cinder-764728a1-ee1d-4c69-9348-8c8de8e13995-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:55:57 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-86858467-03ee-460d-b8e9-8ec4dfd7e562 tempest-VolumesGetTest-1964773963 None] Acquiring lock "cinder-bdd5c2d5-b3ad-4591-b3c8-238eabf46303-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:55:57 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-86858467-03ee-460d-b8e9-8ec4dfd7e562 tempest-VolumesGetTest-1964773963 None] Lock "cinder-bdd5c2d5-b3ad-4591-b3c8-238eabf46303-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:55:57 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-86858467-03ee-460d-b8e9-8ec4dfd7e562 tempest-VolumesGetTest-1964773963 None] Acquiring lock "cinder-quobyte-bdd5c2d5-b3ad-4591-b3c8-238eabf46303" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:55:57 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-86858467-03ee-460d-b8e9-8ec4dfd7e562 tempest-VolumesGetTest-1964773963 None] Lock "cinder-quobyte-bdd5c2d5-b3ad-4591-b3c8-238eabf46303" acquired by "delete_volume" :: waited 0.017s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:55:57 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[4392be92-0b7d-41e0-9030-abfdfacbc5aa]: (4, 'raw') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:55:57 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-86858467-03ee-460d-b8e9-8ec4dfd7e562 tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bdd5c2d5-b3ad-4591-b3c8-238eabf46303 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:57 devstack sudo[90147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bdd5c2d5-b3ad-4591-b3c8-238eabf46303 Apr 24 13:55:57 devstack sudo[90147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:57 devstack sudo[90147]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:57 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-86858467-03ee-460d-b8e9-8ec4dfd7e562 tempest-VolumesGetTest-1964773963 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bdd5c2d5-b3ad-4591-b3c8-238eabf46303" returned: 0 in 0.520s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:57 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-86858467-03ee-460d-b8e9-8ec4dfd7e562 tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bdd5c2d5-b3ad-4591-b3c8-238eabf46303 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:57 devstack sudo[90151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bdd5c2d5-b3ad-4591-b3c8-238eabf46303 Apr 24 13:55:57 devstack sudo[90151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:58 devstack sudo[90151]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-86858467-03ee-460d-b8e9-8ec4dfd7e562 tempest-VolumesGetTest-1964773963 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bdd5c2d5-b3ad-4591-b3c8-238eabf46303" returned: 1 in 0.523s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-86858467-03ee-460d-b8e9-8ec4dfd7e562 tempest-VolumesGetTest-1964773963 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bdd5c2d5-b3ad-4591-b3c8-238eabf46303' failed. Not Retrying. {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 24 13:55:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-86858467-03ee-460d-b8e9-8ec4dfd7e562 tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bdd5c2d5-b3ad-4591-b3c8-238eabf46303 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:58 devstack sudo[90156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bdd5c2d5-b3ad-4591-b3c8-238eabf46303 Apr 24 13:55:58 devstack sudo[90156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:58 devstack sudo[90156]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-86858467-03ee-460d-b8e9-8ec4dfd7e562 tempest-VolumesGetTest-1964773963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-bdd5c2d5-b3ad-4591-b3c8-238eabf46303" returned: 0 in 0.460s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:58 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-86858467-03ee-460d-b8e9-8ec4dfd7e562 tempest-VolumesGetTest-1964773963 None] Lock "cinder-quobyte-bdd5c2d5-b3ad-4591-b3c8-238eabf46303" released by "delete_volume" :: held 1.565s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:55:58 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-86858467-03ee-460d-b8e9-8ec4dfd7e562 tempest-VolumesGetTest-1964773963 None] Created reservations ['8efa7242-984d-4617-9e83-167878b1bc49', '0ac6705c-2a28-4627-9c88-7ff28c110696', 'be868b91-a64d-45f2-9cf2-684a6c68e6a9', '04908304-2342-4ed2-9381-69925167651b'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:55:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-86858467-03ee-460d-b8e9-8ec4dfd7e562 tempest-VolumesGetTest-1964773963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:55:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-86858467-03ee-460d-b8e9-8ec4dfd7e562 tempest-VolumesGetTest-1964773963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:55:58 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-86858467-03ee-460d-b8e9-8ec4dfd7e562 tempest-VolumesGetTest-1964773963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:55:58 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-86858467-03ee-460d-b8e9-8ec4dfd7e562 tempest-VolumesGetTest-1964773963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:55:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-86858467-03ee-460d-b8e9-8ec4dfd7e562 tempest-VolumesGetTest-1964773963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:55:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-86858467-03ee-460d-b8e9-8ec4dfd7e562 tempest-VolumesGetTest-1964773963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:55:58 devstack sudo[90159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:55:58 devstack sudo[90159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:55:59 devstack sudo[90159]: pam_unix(sudo:session): session closed for user root Apr 24 13:55:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-86858467-03ee-460d-b8e9-8ec4dfd7e562 tempest-VolumesGetTest-1964773963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.510s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:55:59 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-86858467-03ee-460d-b8e9-8ec4dfd7e562 tempest-VolumesGetTest-1964773963 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:55:59 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-86858467-03ee-460d-b8e9-8ec4dfd7e562 tempest-VolumesGetTest-1964773963 None] Deleted volume successfully. Apr 24 13:55:59 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-86858467-03ee-460d-b8e9-8ec4dfd7e562 tempest-VolumesGetTest-1964773963 None] Lock "cinder-bdd5c2d5-b3ad-4591-b3c8-238eabf46303-delete_volume" released by "delete_volume" :: held 2.290s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:56:02 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-10542f6a-1cc1-4d37-b7b2-d5a771ea8de2 tempest-VolumesSnapshotListTestJSON-446835402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:56:02 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-10542f6a-1cc1-4d37-b7b2-d5a771ea8de2 tempest-VolumesSnapshotListTestJSON-446835402 None] Flow 'volume_create_manager' (b28ec38b-48a7-4b50-9432-93ea10c2d7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:56:02 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-10542f6a-1cc1-4d37-b7b2-d5a771ea8de2 tempest-VolumesSnapshotListTestJSON-446835402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df7d4b6e-a1ed-4254-bd1b-c359b1fa1f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:02 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-10542f6a-1cc1-4d37-b7b2-d5a771ea8de2 tempest-VolumesSnapshotListTestJSON-446835402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df7d4b6e-a1ed-4254-bd1b-c359b1fa1f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:56:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1671112647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5df30407-b975-4c98-8565-afc2e65ba5c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='116707ccb075409896e24ffc1fb86324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:56:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:56:02Z,use_quota=True,user_id='321597d9117d419086553e17229776dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:02 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-10542f6a-1cc1-4d37-b7b2-d5a771ea8de2 tempest-VolumesSnapshotListTestJSON-446835402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (456a7075-8a7f-47a8-b429-b8fa999945b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:02 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-10542f6a-1cc1-4d37-b7b2-d5a771ea8de2 tempest-VolumesSnapshotListTestJSON-446835402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (456a7075-8a7f-47a8-b429-b8fa999945b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:02 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-10542f6a-1cc1-4d37-b7b2-d5a771ea8de2 tempest-VolumesSnapshotListTestJSON-446835402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e0d3ea5-3c99-498c-9475-657f6282610a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:02 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-10542f6a-1cc1-4d37-b7b2-d5a771ea8de2 tempest-VolumesSnapshotListTestJSON-446835402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e0d3ea5-3c99-498c-9475-657f6282610a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5df30407-b975-4c98-8565-afc2e65ba5c2', 'volume_name': 'volume-5df30407-b975-4c98-8565-afc2e65ba5c2', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:02 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-10542f6a-1cc1-4d37-b7b2-d5a771ea8de2 tempest-VolumesSnapshotListTestJSON-446835402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b03a6e66-2da6-45e4-bff0-a6ca80fbecba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:02 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-10542f6a-1cc1-4d37-b7b2-d5a771ea8de2 tempest-VolumesSnapshotListTestJSON-446835402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b03a6e66-2da6-45e4-bff0-a6ca80fbecba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:02 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-10542f6a-1cc1-4d37-b7b2-d5a771ea8de2 tempest-VolumesSnapshotListTestJSON-446835402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9293ee5-c748-431a-adc7-f4285a9fd529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:02 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-10542f6a-1cc1-4d37-b7b2-d5a771ea8de2 tempest-VolumesSnapshotListTestJSON-446835402 None] Volume 5df30407-b975-4c98-8565-afc2e65ba5c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5df30407-b975-4c98-8565-afc2e65ba5c2', 'volume_size': 1} Apr 24 13:56:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-10542f6a-1cc1-4d37-b7b2-d5a771ea8de2 tempest-VolumesSnapshotListTestJSON-446835402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:56:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-10542f6a-1cc1-4d37-b7b2-d5a771ea8de2 tempest-VolumesSnapshotListTestJSON-446835402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:56:02 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-10542f6a-1cc1-4d37-b7b2-d5a771ea8de2 tempest-VolumesSnapshotListTestJSON-446835402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:56:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1671112647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5df30407-b975-4c98-8565-afc2e65ba5c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='116707ccb075409896e24ffc1fb86324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:56:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:56:02Z,use_quota=True,user_id='321597d9117d419086553e17229776dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:56:02 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-10542f6a-1cc1-4d37-b7b2-d5a771ea8de2 tempest-VolumesSnapshotListTestJSON-446835402 None] Creating volume 5df30407-b975-4c98-8565-afc2e65ba5c2 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:56:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-10542f6a-1cc1-4d37-b7b2-d5a771ea8de2 tempest-VolumesSnapshotListTestJSON-446835402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:56:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-10542f6a-1cc1-4d37-b7b2-d5a771ea8de2 tempest-VolumesSnapshotListTestJSON-446835402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:56:02 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-10542f6a-1cc1-4d37-b7b2-d5a771ea8de2 tempest-VolumesSnapshotListTestJSON-446835402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:56:02 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-10542f6a-1cc1-4d37-b7b2-d5a771ea8de2 tempest-VolumesSnapshotListTestJSON-446835402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:56:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-10542f6a-1cc1-4d37-b7b2-d5a771ea8de2 tempest-VolumesSnapshotListTestJSON-446835402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:56:02 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-10542f6a-1cc1-4d37-b7b2-d5a771ea8de2 tempest-VolumesSnapshotListTestJSON-446835402 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:56:02 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-10542f6a-1cc1-4d37-b7b2-d5a771ea8de2 tempest-VolumesSnapshotListTestJSON-446835402 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:56:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-10542f6a-1cc1-4d37-b7b2-d5a771ea8de2 tempest-VolumesSnapshotListTestJSON-446835402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:02 devstack sudo[90162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2 1073741824 Apr 24 13:56:02 devstack sudo[90162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:02 devstack sudo[90162]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-10542f6a-1cc1-4d37-b7b2-d5a771ea8de2 tempest-VolumesSnapshotListTestJSON-446835402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2 1073741824" returned: 0 in 0.611s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-10542f6a-1cc1-4d37-b7b2-d5a771ea8de2 tempest-VolumesSnapshotListTestJSON-446835402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:02 devstack sudo[90167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2 Apr 24 13:56:02 devstack sudo[90167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:03 devstack sudo[90167]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-10542f6a-1cc1-4d37-b7b2-d5a771ea8de2 tempest-VolumesSnapshotListTestJSON-446835402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2" returned: 0 in 0.458s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:03 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-10542f6a-1cc1-4d37-b7b2-d5a771ea8de2 tempest-VolumesSnapshotListTestJSON-446835402 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:56:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-10542f6a-1cc1-4d37-b7b2-d5a771ea8de2 tempest-VolumesSnapshotListTestJSON-446835402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:56:03 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-10542f6a-1cc1-4d37-b7b2-d5a771ea8de2 tempest-VolumesSnapshotListTestJSON-446835402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9293ee5-c748-431a-adc7-f4285a9fd529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5df30407-b975-4c98-8565-afc2e65ba5c2', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:03 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-10542f6a-1cc1-4d37-b7b2-d5a771ea8de2 tempest-VolumesSnapshotListTestJSON-446835402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ead3af0-0c61-4fea-a3f2-807daa904757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:03 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-10542f6a-1cc1-4d37-b7b2-d5a771ea8de2 tempest-VolumesSnapshotListTestJSON-446835402 None] Volume volume-5df30407-b975-4c98-8565-afc2e65ba5c2 (5df30407-b975-4c98-8565-afc2e65ba5c2): created successfully Apr 24 13:56:03 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-10542f6a-1cc1-4d37-b7b2-d5a771ea8de2 tempest-VolumesSnapshotListTestJSON-446835402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ead3af0-0c61-4fea-a3f2-807daa904757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:03 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-10542f6a-1cc1-4d37-b7b2-d5a771ea8de2 tempest-VolumesSnapshotListTestJSON-446835402 None] Flow 'volume_create_manager' (b28ec38b-48a7-4b50-9432-93ea10c2d7b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:56:03 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-10542f6a-1cc1-4d37-b7b2-d5a771ea8de2 tempest-VolumesSnapshotListTestJSON-446835402 None] Created volume successfully. Apr 24 13:56:04 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5ee4a56e-103d-49c5-bfaf-fc3447590afe tempest-VolumesSnapshotListTestJSON-446835402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:56:04 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5ee4a56e-103d-49c5-bfaf-fc3447590afe tempest-VolumesSnapshotListTestJSON-446835402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:56:04 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-5ee4a56e-103d-49c5-bfaf-fc3447590afe tempest-VolumesSnapshotListTestJSON-446835402 None] Creating offline snapshot 81ae9f96-2034-48bc-b956-4a284f2e84e2 of volume 5df30407-b975-4c98-8565-afc2e65ba5c2 {{(pid=82046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 13:56:04 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6193d86-d538-4f64-b64f-02b9179b8b0a]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:56:04 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ee4a56e-103d-49c5-bfaf-fc3447590afe tempest-VolumesSnapshotListTestJSON-446835402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:04 devstack sudo[90170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2 Apr 24 13:56:04 devstack sudo[90170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:05 devstack sudo[90170]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:05 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ee4a56e-103d-49c5-bfaf-fc3447590afe tempest-VolumesSnapshotListTestJSON-446835402 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2" returned: 0 in 0.563s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:05 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ee4a56e-103d-49c5-bfaf-fc3447590afe tempest-VolumesSnapshotListTestJSON-446835402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.81ae9f96-2034-48bc-b956-4a284f2e84e2 1G {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:05 devstack sudo[90175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.81ae9f96-2034-48bc-b956-4a284f2e84e2 1G Apr 24 13:56:05 devstack sudo[90175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:05 devstack sudo[90175]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:05 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ee4a56e-103d-49c5-bfaf-fc3447590afe tempest-VolumesSnapshotListTestJSON-446835402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.81ae9f96-2034-48bc-b956-4a284f2e84e2 1G" returned: 0 in 0.617s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:05 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ee4a56e-103d-49c5-bfaf-fc3447590afe tempest-VolumesSnapshotListTestJSON-446835402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5df30407-b975-4c98-8565-afc2e65ba5c2 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.81ae9f96-2034-48bc-b956-4a284f2e84e2 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:05 devstack sudo[90182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5df30407-b975-4c98-8565-afc2e65ba5c2 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.81ae9f96-2034-48bc-b956-4a284f2e84e2 Apr 24 13:56:05 devstack sudo[90182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:06 devstack sudo[90182]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ee4a56e-103d-49c5-bfaf-fc3447590afe tempest-VolumesSnapshotListTestJSON-446835402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5df30407-b975-4c98-8565-afc2e65ba5c2 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.81ae9f96-2034-48bc-b956-4a284f2e84e2" returned: 0 in 0.534s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:06 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-5ee4a56e-103d-49c5-bfaf-fc3447590afe tempest-VolumesSnapshotListTestJSON-446835402 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.81ae9f96-2034-48bc-b956-4a284f2e84e2 is being set with open permissions: ugo+rw Apr 24 13:56:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ee4a56e-103d-49c5-bfaf-fc3447590afe tempest-VolumesSnapshotListTestJSON-446835402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.81ae9f96-2034-48bc-b956-4a284f2e84e2 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:06 devstack sudo[90187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.81ae9f96-2034-48bc-b956-4a284f2e84e2 Apr 24 13:56:06 devstack sudo[90187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:06 devstack sudo[90187]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ee4a56e-103d-49c5-bfaf-fc3447590afe tempest-VolumesSnapshotListTestJSON-446835402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.81ae9f96-2034-48bc-b956-4a284f2e84e2" returned: 0 in 0.549s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:06 devstack cinder-volume[82046]: DEBUG dbcounter [-] [82046] Writing DB stats cinder:UPDATE=91,cinder:SELECT=68,cinder:DELETE=8,cinder:INSERT=23 {{(pid=82046) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 13:56:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ee4a56e-103d-49c5-bfaf-fc3447590afe tempest-VolumesSnapshotListTestJSON-446835402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:06 devstack sudo[90190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.info Apr 24 13:56:06 devstack sudo[90190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:07 devstack sudo[90190]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ee4a56e-103d-49c5-bfaf-fc3447590afe tempest-VolumesSnapshotListTestJSON-446835402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.info" returned: 0 in 0.529s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:07 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-5ee4a56e-103d-49c5-bfaf-fc3447590afe tempest-VolumesSnapshotListTestJSON-446835402 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.info is being set with open permissions: ugo+rw Apr 24 13:56:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ee4a56e-103d-49c5-bfaf-fc3447590afe tempest-VolumesSnapshotListTestJSON-446835402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:07 devstack sudo[90193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.info Apr 24 13:56:07 devstack sudo[90193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:07 devstack sudo[90193]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ee4a56e-103d-49c5-bfaf-fc3447590afe tempest-VolumesSnapshotListTestJSON-446835402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.info" returned: 0 in 0.488s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5ee4a56e-103d-49c5-bfaf-fc3447590afe tempest-VolumesSnapshotListTestJSON-446835402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.383s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:56:07 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-5ee4a56e-103d-49c5-bfaf-fc3447590afe tempest-VolumesSnapshotListTestJSON-446835402 None] Create snapshot completed successfully Apr 24 13:56:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-3b04e701-b35c-4bad-acba-1571d6a4278d tempest-VolumesSnapshotListTestJSON-446835402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:56:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-3b04e701-b35c-4bad-acba-1571d6a4278d tempest-VolumesSnapshotListTestJSON-446835402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:56:08 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-3b04e701-b35c-4bad-acba-1571d6a4278d tempest-VolumesSnapshotListTestJSON-446835402 None] Creating offline snapshot 2301690e-6f0f-435a-b861-ff7523965a33 of volume 5df30407-b975-4c98-8565-afc2e65ba5c2 {{(pid=82046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 13:56:08 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46f860b-c9ed-4fc3-a5fd-f963e043e9d9]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:56:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3b04e701-b35c-4bad-acba-1571d6a4278d tempest-VolumesSnapshotListTestJSON-446835402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.81ae9f96-2034-48bc-b956-4a284f2e84e2 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:08 devstack sudo[90196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.81ae9f96-2034-48bc-b956-4a284f2e84e2 Apr 24 13:56:08 devstack sudo[90196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:09 devstack sudo[90196]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3b04e701-b35c-4bad-acba-1571d6a4278d tempest-VolumesSnapshotListTestJSON-446835402 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.81ae9f96-2034-48bc-b956-4a284f2e84e2" returned: 0 in 0.593s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:09 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-3b04e701-b35c-4bad-acba-1571d6a4278d tempest-VolumesSnapshotListTestJSON-446835402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5df30407-b975-4c98-8565-afc2e65ba5c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:56:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3b04e701-b35c-4bad-acba-1571d6a4278d tempest-VolumesSnapshotListTestJSON-446835402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.81ae9f96-2034-48bc-b956-4a284f2e84e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.2301690e-6f0f-435a-b861-ff7523965a33 1G {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:09 devstack sudo[90201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.81ae9f96-2034-48bc-b956-4a284f2e84e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.2301690e-6f0f-435a-b861-ff7523965a33 1G Apr 24 13:56:09 devstack sudo[90201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:10 devstack sudo[90201]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:10 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3b04e701-b35c-4bad-acba-1571d6a4278d tempest-VolumesSnapshotListTestJSON-446835402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.81ae9f96-2034-48bc-b956-4a284f2e84e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.2301690e-6f0f-435a-b861-ff7523965a33 1G" returned: 0 in 0.671s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:10 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3b04e701-b35c-4bad-acba-1571d6a4278d tempest-VolumesSnapshotListTestJSON-446835402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5df30407-b975-4c98-8565-afc2e65ba5c2.81ae9f96-2034-48bc-b956-4a284f2e84e2 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.2301690e-6f0f-435a-b861-ff7523965a33 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:10 devstack sudo[90206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5df30407-b975-4c98-8565-afc2e65ba5c2.81ae9f96-2034-48bc-b956-4a284f2e84e2 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.2301690e-6f0f-435a-b861-ff7523965a33 Apr 24 13:56:10 devstack sudo[90206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:10 devstack sudo[90206]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:10 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3b04e701-b35c-4bad-acba-1571d6a4278d tempest-VolumesSnapshotListTestJSON-446835402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5df30407-b975-4c98-8565-afc2e65ba5c2.81ae9f96-2034-48bc-b956-4a284f2e84e2 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.2301690e-6f0f-435a-b861-ff7523965a33" returned: 0 in 0.557s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:10 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-3b04e701-b35c-4bad-acba-1571d6a4278d tempest-VolumesSnapshotListTestJSON-446835402 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.2301690e-6f0f-435a-b861-ff7523965a33 is being set with open permissions: ugo+rw Apr 24 13:56:10 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3b04e701-b35c-4bad-acba-1571d6a4278d tempest-VolumesSnapshotListTestJSON-446835402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.2301690e-6f0f-435a-b861-ff7523965a33 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:10 devstack sudo[90211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.2301690e-6f0f-435a-b861-ff7523965a33 Apr 24 13:56:10 devstack sudo[90211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:11 devstack sudo[90211]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3b04e701-b35c-4bad-acba-1571d6a4278d tempest-VolumesSnapshotListTestJSON-446835402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.2301690e-6f0f-435a-b861-ff7523965a33" returned: 0 in 0.496s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-3b04e701-b35c-4bad-acba-1571d6a4278d tempest-VolumesSnapshotListTestJSON-446835402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.429s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:56:11 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-3b04e701-b35c-4bad-acba-1571d6a4278d tempest-VolumesSnapshotListTestJSON-446835402 None] Create snapshot completed successfully Apr 24 13:56:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-70e55556-2bf3-4164-860f-094a661359e3 tempest-VolumesSnapshotListTestJSON-446835402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:56:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-70e55556-2bf3-4164-860f-094a661359e3 tempest-VolumesSnapshotListTestJSON-446835402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:56:12 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-70e55556-2bf3-4164-860f-094a661359e3 tempest-VolumesSnapshotListTestJSON-446835402 None] Creating offline snapshot fcddf785-00e9-47d6-b15b-3116759942bd of volume 5df30407-b975-4c98-8565-afc2e65ba5c2 {{(pid=82046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 13:56:12 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e0841c-eae0-4fb0-9e0a-c2ab17d2849f]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:56:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-70e55556-2bf3-4164-860f-094a661359e3 tempest-VolumesSnapshotListTestJSON-446835402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.2301690e-6f0f-435a-b861-ff7523965a33 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:12 devstack sudo[90214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.2301690e-6f0f-435a-b861-ff7523965a33 Apr 24 13:56:12 devstack sudo[90214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:12 devstack sudo[90214]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-70e55556-2bf3-4164-860f-094a661359e3 tempest-VolumesSnapshotListTestJSON-446835402 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.2301690e-6f0f-435a-b861-ff7523965a33" returned: 0 in 0.564s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:12 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-70e55556-2bf3-4164-860f-094a661359e3 tempest-VolumesSnapshotListTestJSON-446835402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5df30407-b975-4c98-8565-afc2e65ba5c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:56:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-70e55556-2bf3-4164-860f-094a661359e3 tempest-VolumesSnapshotListTestJSON-446835402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.2301690e-6f0f-435a-b861-ff7523965a33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.fcddf785-00e9-47d6-b15b-3116759942bd 1G {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:12 devstack sudo[90219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.2301690e-6f0f-435a-b861-ff7523965a33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.fcddf785-00e9-47d6-b15b-3116759942bd 1G Apr 24 13:56:12 devstack sudo[90219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:13 devstack sudo[90219]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-70e55556-2bf3-4164-860f-094a661359e3 tempest-VolumesSnapshotListTestJSON-446835402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.2301690e-6f0f-435a-b861-ff7523965a33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.fcddf785-00e9-47d6-b15b-3116759942bd 1G" returned: 0 in 0.730s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-70e55556-2bf3-4164-860f-094a661359e3 tempest-VolumesSnapshotListTestJSON-446835402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5df30407-b975-4c98-8565-afc2e65ba5c2.2301690e-6f0f-435a-b861-ff7523965a33 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.fcddf785-00e9-47d6-b15b-3116759942bd {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:13 devstack sudo[90224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5df30407-b975-4c98-8565-afc2e65ba5c2.2301690e-6f0f-435a-b861-ff7523965a33 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.fcddf785-00e9-47d6-b15b-3116759942bd Apr 24 13:56:13 devstack sudo[90224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:14 devstack sudo[90224]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-70e55556-2bf3-4164-860f-094a661359e3 tempest-VolumesSnapshotListTestJSON-446835402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5df30407-b975-4c98-8565-afc2e65ba5c2.2301690e-6f0f-435a-b861-ff7523965a33 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.fcddf785-00e9-47d6-b15b-3116759942bd" returned: 0 in 0.557s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:14 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-70e55556-2bf3-4164-860f-094a661359e3 tempest-VolumesSnapshotListTestJSON-446835402 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.fcddf785-00e9-47d6-b15b-3116759942bd is being set with open permissions: ugo+rw Apr 24 13:56:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-70e55556-2bf3-4164-860f-094a661359e3 tempest-VolumesSnapshotListTestJSON-446835402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.fcddf785-00e9-47d6-b15b-3116759942bd {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:14 devstack sudo[90229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.fcddf785-00e9-47d6-b15b-3116759942bd Apr 24 13:56:14 devstack sudo[90229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:14 devstack sudo[90229]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-70e55556-2bf3-4164-860f-094a661359e3 tempest-VolumesSnapshotListTestJSON-446835402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.fcddf785-00e9-47d6-b15b-3116759942bd" returned: 0 in 0.494s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-70e55556-2bf3-4164-860f-094a661359e3 tempest-VolumesSnapshotListTestJSON-446835402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.474s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:56:14 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-70e55556-2bf3-4164-860f-094a661359e3 tempest-VolumesSnapshotListTestJSON-446835402 None] Create snapshot completed successfully Apr 24 13:56:16 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ebd8ec1a-02c4-4975-a77c-0fbc4a7e983c tempest-VolumesSnapshotListTestJSON-446835402 None] Acquiring lock "cinder-fcddf785-00e9-47d6-b15b-3116759942bd-delete_snapshot" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:56:16 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ebd8ec1a-02c4-4975-a77c-0fbc4a7e983c tempest-VolumesSnapshotListTestJSON-446835402 None] Lock "cinder-fcddf785-00e9-47d6-b15b-3116759942bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:56:16 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ebd8ec1a-02c4-4975-a77c-0fbc4a7e983c tempest-VolumesSnapshotListTestJSON-446835402 None] Acquiring lock "cinder-quobyte-5df30407-b975-4c98-8565-afc2e65ba5c2" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:56:16 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ebd8ec1a-02c4-4975-a77c-0fbc4a7e983c tempest-VolumesSnapshotListTestJSON-446835402 None] Lock "cinder-quobyte-5df30407-b975-4c98-8565-afc2e65ba5c2" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:56:16 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ebd8ec1a-02c4-4975-a77c-0fbc4a7e983c tempest-VolumesSnapshotListTestJSON-446835402 None] Acquiring lock "cinder-quobyte-fcddf785-00e9-47d6-b15b-3116759942bd" by "_delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:56:16 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ebd8ec1a-02c4-4975-a77c-0fbc4a7e983c tempest-VolumesSnapshotListTestJSON-446835402 None] Lock "cinder-quobyte-fcddf785-00e9-47d6-b15b-3116759942bd" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:56:16 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-ebd8ec1a-02c4-4975-a77c-0fbc4a7e983c tempest-VolumesSnapshotListTestJSON-446835402 None] Deleting offline snapshot fcddf785-00e9-47d6-b15b-3116759942bd of volume 5df30407-b975-4c98-8565-afc2e65ba5c2 {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 13:56:16 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-ebd8ec1a-02c4-4975-a77c-0fbc4a7e983c tempest-VolumesSnapshotListTestJSON-446835402 None] snapshot_file for this snap is: volume-5df30407-b975-4c98-8565-afc2e65ba5c2.fcddf785-00e9-47d6-b15b-3116759942bd {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 13:56:16 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[b821ed9e-002e-4c41-bd9b-e3df77b5e783]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:56:16 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ebd8ec1a-02c4-4975-a77c-0fbc4a7e983c tempest-VolumesSnapshotListTestJSON-446835402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.fcddf785-00e9-47d6-b15b-3116759942bd {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:16 devstack sudo[90233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.fcddf785-00e9-47d6-b15b-3116759942bd Apr 24 13:56:16 devstack sudo[90233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:16 devstack sudo[90233]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:16 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ebd8ec1a-02c4-4975-a77c-0fbc4a7e983c tempest-VolumesSnapshotListTestJSON-446835402 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.fcddf785-00e9-47d6-b15b-3116759942bd" returned: 0 in 0.636s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:16 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-ebd8ec1a-02c4-4975-a77c-0fbc4a7e983c tempest-VolumesSnapshotListTestJSON-446835402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5df30407-b975-4c98-8565-afc2e65ba5c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:56:16 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9a2f75-a5f7-4c79-b993-dd39b19a7236]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:56:16 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ebd8ec1a-02c4-4975-a77c-0fbc4a7e983c tempest-VolumesSnapshotListTestJSON-446835402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.2301690e-6f0f-435a-b861-ff7523965a33 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:16 devstack sudo[90238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.2301690e-6f0f-435a-b861-ff7523965a33 Apr 24 13:56:16 devstack sudo[90238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:17 devstack sudo[90238]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ebd8ec1a-02c4-4975-a77c-0fbc4a7e983c tempest-VolumesSnapshotListTestJSON-446835402 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.2301690e-6f0f-435a-b861-ff7523965a33" returned: 0 in 0.598s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:17 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-ebd8ec1a-02c4-4975-a77c-0fbc4a7e983c tempest-VolumesSnapshotListTestJSON-446835402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5df30407-b975-4c98-8565-afc2e65ba5c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:56:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ebd8ec1a-02c4-4975-a77c-0fbc4a7e983c tempest-VolumesSnapshotListTestJSON-446835402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.fcddf785-00e9-47d6-b15b-3116759942bd {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:17 devstack sudo[90243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.fcddf785-00e9-47d6-b15b-3116759942bd Apr 24 13:56:17 devstack sudo[90243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:18 devstack sudo[90243]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:18 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ebd8ec1a-02c4-4975-a77c-0fbc4a7e983c tempest-VolumesSnapshotListTestJSON-446835402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.fcddf785-00e9-47d6-b15b-3116759942bd" returned: 0 in 0.759s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:18 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ebd8ec1a-02c4-4975-a77c-0fbc4a7e983c tempest-VolumesSnapshotListTestJSON-446835402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.fcddf785-00e9-47d6-b15b-3116759942bd {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:18 devstack sudo[90248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.fcddf785-00e9-47d6-b15b-3116759942bd Apr 24 13:56:18 devstack sudo[90248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:18 devstack sudo[90248]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:18 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ebd8ec1a-02c4-4975-a77c-0fbc4a7e983c tempest-VolumesSnapshotListTestJSON-446835402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.fcddf785-00e9-47d6-b15b-3116759942bd" returned: 0 in 0.485s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:18 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ebd8ec1a-02c4-4975-a77c-0fbc4a7e983c tempest-VolumesSnapshotListTestJSON-446835402 None] Lock "cinder-quobyte-fcddf785-00e9-47d6-b15b-3116759942bd" released by "_delete_snapshot" :: held 2.582s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:56:18 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ebd8ec1a-02c4-4975-a77c-0fbc4a7e983c tempest-VolumesSnapshotListTestJSON-446835402 None] Lock "cinder-quobyte-5df30407-b975-4c98-8565-afc2e65ba5c2" released by "delete_snapshot" :: held 2.610s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:56:18 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-ebd8ec1a-02c4-4975-a77c-0fbc4a7e983c tempest-VolumesSnapshotListTestJSON-446835402 None] Created reservations ['5fc7171d-ce82-4e6a-931e-0ad32c9b3d96', '456fb846-dd3a-40b3-ac7a-ba42fda4eae7', '750f8af3-8842-4231-91ac-e007812c8e14', '4edcec54-9620-42c0-b6eb-26ec0b7fed59'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:56:18 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-ebd8ec1a-02c4-4975-a77c-0fbc4a7e983c tempest-VolumesSnapshotListTestJSON-446835402 None] Delete snapshot completed successfully. Apr 24 13:56:18 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ebd8ec1a-02c4-4975-a77c-0fbc4a7e983c tempest-VolumesSnapshotListTestJSON-446835402 None] Lock "cinder-fcddf785-00e9-47d6-b15b-3116759942bd-delete_snapshot" released by "delete_snapshot" :: held 2.776s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:56:19 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-fc30e4ab-c3b3-4f28-a432-a98aeb46d51f tempest-VolumesSnapshotListTestJSON-446835402 None] Acquiring lock "cinder-2301690e-6f0f-435a-b861-ff7523965a33-delete_snapshot" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:56:19 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-fc30e4ab-c3b3-4f28-a432-a98aeb46d51f tempest-VolumesSnapshotListTestJSON-446835402 None] Lock "cinder-2301690e-6f0f-435a-b861-ff7523965a33-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:56:19 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-fc30e4ab-c3b3-4f28-a432-a98aeb46d51f tempest-VolumesSnapshotListTestJSON-446835402 None] Acquiring lock "cinder-quobyte-5df30407-b975-4c98-8565-afc2e65ba5c2" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:56:19 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-fc30e4ab-c3b3-4f28-a432-a98aeb46d51f tempest-VolumesSnapshotListTestJSON-446835402 None] Lock "cinder-quobyte-5df30407-b975-4c98-8565-afc2e65ba5c2" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:56:19 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-fc30e4ab-c3b3-4f28-a432-a98aeb46d51f tempest-VolumesSnapshotListTestJSON-446835402 None] Acquiring lock "cinder-quobyte-2301690e-6f0f-435a-b861-ff7523965a33" by "_delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:56:19 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-fc30e4ab-c3b3-4f28-a432-a98aeb46d51f tempest-VolumesSnapshotListTestJSON-446835402 None] Lock "cinder-quobyte-2301690e-6f0f-435a-b861-ff7523965a33" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:56:19 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-fc30e4ab-c3b3-4f28-a432-a98aeb46d51f tempest-VolumesSnapshotListTestJSON-446835402 None] Deleting offline snapshot 2301690e-6f0f-435a-b861-ff7523965a33 of volume 5df30407-b975-4c98-8565-afc2e65ba5c2 {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 13:56:19 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-fc30e4ab-c3b3-4f28-a432-a98aeb46d51f tempest-VolumesSnapshotListTestJSON-446835402 None] snapshot_file for this snap is: volume-5df30407-b975-4c98-8565-afc2e65ba5c2.2301690e-6f0f-435a-b861-ff7523965a33 {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 13:56:19 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf80a922-41d7-4106-a86f-77629d6c8fee]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:56:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-fc30e4ab-c3b3-4f28-a432-a98aeb46d51f tempest-VolumesSnapshotListTestJSON-446835402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.2301690e-6f0f-435a-b861-ff7523965a33 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:19 devstack sudo[90285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.2301690e-6f0f-435a-b861-ff7523965a33 Apr 24 13:56:19 devstack sudo[90285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:19 devstack sudo[90285]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-fc30e4ab-c3b3-4f28-a432-a98aeb46d51f tempest-VolumesSnapshotListTestJSON-446835402 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.2301690e-6f0f-435a-b861-ff7523965a33" returned: 0 in 0.623s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:19 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-fc30e4ab-c3b3-4f28-a432-a98aeb46d51f tempest-VolumesSnapshotListTestJSON-446835402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5df30407-b975-4c98-8565-afc2e65ba5c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:56:19 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[71591d0f-b4fa-4ab5-8c4b-f35b8af5a207]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:56:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-fc30e4ab-c3b3-4f28-a432-a98aeb46d51f tempest-VolumesSnapshotListTestJSON-446835402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.81ae9f96-2034-48bc-b956-4a284f2e84e2 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:20 devstack sudo[90290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.81ae9f96-2034-48bc-b956-4a284f2e84e2 Apr 24 13:56:20 devstack sudo[90290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:20 devstack sudo[90290]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:20 devstack sudo[90297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.2301690e-6f0f-435a-b861-ff7523965a33 Apr 24 13:56:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-fc30e4ab-c3b3-4f28-a432-a98aeb46d51f tempest-VolumesSnapshotListTestJSON-446835402 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.81ae9f96-2034-48bc-b956-4a284f2e84e2" returned: 0 in 0.602s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:20 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-fc30e4ab-c3b3-4f28-a432-a98aeb46d51f tempest-VolumesSnapshotListTestJSON-446835402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5df30407-b975-4c98-8565-afc2e65ba5c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:56:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-fc30e4ab-c3b3-4f28-a432-a98aeb46d51f tempest-VolumesSnapshotListTestJSON-446835402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.2301690e-6f0f-435a-b861-ff7523965a33 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:20 devstack sudo[90297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:21 devstack sudo[90297]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-fc30e4ab-c3b3-4f28-a432-a98aeb46d51f tempest-VolumesSnapshotListTestJSON-446835402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.2301690e-6f0f-435a-b861-ff7523965a33" returned: 0 in 0.757s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-fc30e4ab-c3b3-4f28-a432-a98aeb46d51f tempest-VolumesSnapshotListTestJSON-446835402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.2301690e-6f0f-435a-b861-ff7523965a33 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:21 devstack sudo[90302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.2301690e-6f0f-435a-b861-ff7523965a33 Apr 24 13:56:21 devstack sudo[90302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:21 devstack sudo[90302]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-fc30e4ab-c3b3-4f28-a432-a98aeb46d51f tempest-VolumesSnapshotListTestJSON-446835402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.2301690e-6f0f-435a-b861-ff7523965a33" returned: 0 in 0.527s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:21 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-fc30e4ab-c3b3-4f28-a432-a98aeb46d51f tempest-VolumesSnapshotListTestJSON-446835402 None] Lock "cinder-quobyte-2301690e-6f0f-435a-b861-ff7523965a33" released by "_delete_snapshot" :: held 2.617s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:56:21 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-fc30e4ab-c3b3-4f28-a432-a98aeb46d51f tempest-VolumesSnapshotListTestJSON-446835402 None] Lock "cinder-quobyte-5df30407-b975-4c98-8565-afc2e65ba5c2" released by "delete_snapshot" :: held 2.645s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:56:22 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-fc30e4ab-c3b3-4f28-a432-a98aeb46d51f tempest-VolumesSnapshotListTestJSON-446835402 None] Created reservations ['f5fdd42b-383a-4eda-8e79-875b1a8620e0', '7394d186-4ff3-400e-836c-3a47a3fcedfa', 'e48e074e-ad27-4f93-98f4-049934d1847b', '654d695c-7bf7-46ea-9afc-c69a5ddc5846'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:56:22 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-fc30e4ab-c3b3-4f28-a432-a98aeb46d51f tempest-VolumesSnapshotListTestJSON-446835402 None] Delete snapshot completed successfully. Apr 24 13:56:22 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-fc30e4ab-c3b3-4f28-a432-a98aeb46d51f tempest-VolumesSnapshotListTestJSON-446835402 None] Lock "cinder-2301690e-6f0f-435a-b861-ff7523965a33-delete_snapshot" released by "delete_snapshot" :: held 2.816s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:56:22 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e9b738af-ad39-4a6b-95b7-53873178dd18 tempest-VolumesSnapshotListTestJSON-446835402 None] Acquiring lock "cinder-81ae9f96-2034-48bc-b956-4a284f2e84e2-delete_snapshot" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:56:22 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e9b738af-ad39-4a6b-95b7-53873178dd18 tempest-VolumesSnapshotListTestJSON-446835402 None] Lock "cinder-81ae9f96-2034-48bc-b956-4a284f2e84e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:56:22 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e9b738af-ad39-4a6b-95b7-53873178dd18 tempest-VolumesSnapshotListTestJSON-446835402 None] Acquiring lock "cinder-quobyte-5df30407-b975-4c98-8565-afc2e65ba5c2" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:56:22 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e9b738af-ad39-4a6b-95b7-53873178dd18 tempest-VolumesSnapshotListTestJSON-446835402 None] Lock "cinder-quobyte-5df30407-b975-4c98-8565-afc2e65ba5c2" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:56:22 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e9b738af-ad39-4a6b-95b7-53873178dd18 tempest-VolumesSnapshotListTestJSON-446835402 None] Acquiring lock "cinder-quobyte-81ae9f96-2034-48bc-b956-4a284f2e84e2" by "_delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:56:22 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e9b738af-ad39-4a6b-95b7-53873178dd18 tempest-VolumesSnapshotListTestJSON-446835402 None] Lock "cinder-quobyte-81ae9f96-2034-48bc-b956-4a284f2e84e2" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:56:22 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-e9b738af-ad39-4a6b-95b7-53873178dd18 tempest-VolumesSnapshotListTestJSON-446835402 None] Deleting offline snapshot 81ae9f96-2034-48bc-b956-4a284f2e84e2 of volume 5df30407-b975-4c98-8565-afc2e65ba5c2 {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 13:56:22 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-e9b738af-ad39-4a6b-95b7-53873178dd18 tempest-VolumesSnapshotListTestJSON-446835402 None] snapshot_file for this snap is: volume-5df30407-b975-4c98-8565-afc2e65ba5c2.81ae9f96-2034-48bc-b956-4a284f2e84e2 {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 13:56:22 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6a7064-34e2-4902-b1e0-8233bedaca6b]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:56:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e9b738af-ad39-4a6b-95b7-53873178dd18 tempest-VolumesSnapshotListTestJSON-446835402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.81ae9f96-2034-48bc-b956-4a284f2e84e2 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:22 devstack sudo[90305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.81ae9f96-2034-48bc-b956-4a284f2e84e2 Apr 24 13:56:22 devstack sudo[90305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:23 devstack sudo[90305]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:23 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e9b738af-ad39-4a6b-95b7-53873178dd18 tempest-VolumesSnapshotListTestJSON-446835402 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.81ae9f96-2034-48bc-b956-4a284f2e84e2" returned: 0 in 0.591s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:23 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-e9b738af-ad39-4a6b-95b7-53873178dd18 tempest-VolumesSnapshotListTestJSON-446835402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5df30407-b975-4c98-8565-afc2e65ba5c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:56:23 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f945c7-1163-4f6b-8d2e-1622e862d362]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:56:23 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e9b738af-ad39-4a6b-95b7-53873178dd18 tempest-VolumesSnapshotListTestJSON-446835402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:23 devstack sudo[90310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2 Apr 24 13:56:23 devstack sudo[90310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:23 devstack sudo[90310]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:23 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e9b738af-ad39-4a6b-95b7-53873178dd18 tempest-VolumesSnapshotListTestJSON-446835402 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2" returned: 0 in 0.617s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:23 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e9b738af-ad39-4a6b-95b7-53873178dd18 tempest-VolumesSnapshotListTestJSON-446835402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.81ae9f96-2034-48bc-b956-4a284f2e84e2 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:23 devstack sudo[90315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.81ae9f96-2034-48bc-b956-4a284f2e84e2 Apr 24 13:56:23 devstack sudo[90315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:24 devstack sudo[90315]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e9b738af-ad39-4a6b-95b7-53873178dd18 tempest-VolumesSnapshotListTestJSON-446835402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.81ae9f96-2034-48bc-b956-4a284f2e84e2" returned: 0 in 0.587s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e9b738af-ad39-4a6b-95b7-53873178dd18 tempest-VolumesSnapshotListTestJSON-446835402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.81ae9f96-2034-48bc-b956-4a284f2e84e2 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:24 devstack sudo[90320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.81ae9f96-2034-48bc-b956-4a284f2e84e2 Apr 24 13:56:24 devstack sudo[90320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:24 devstack sudo[90320]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e9b738af-ad39-4a6b-95b7-53873178dd18 tempest-VolumesSnapshotListTestJSON-446835402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2.81ae9f96-2034-48bc-b956-4a284f2e84e2" returned: 0 in 0.514s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:24 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e9b738af-ad39-4a6b-95b7-53873178dd18 tempest-VolumesSnapshotListTestJSON-446835402 None] Lock "cinder-quobyte-81ae9f96-2034-48bc-b956-4a284f2e84e2" released by "_delete_snapshot" :: held 2.429s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:56:24 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e9b738af-ad39-4a6b-95b7-53873178dd18 tempest-VolumesSnapshotListTestJSON-446835402 None] Lock "cinder-quobyte-5df30407-b975-4c98-8565-afc2e65ba5c2" released by "delete_snapshot" :: held 2.456s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:56:25 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-e9b738af-ad39-4a6b-95b7-53873178dd18 tempest-VolumesSnapshotListTestJSON-446835402 None] Created reservations ['44138286-1132-4b9b-8914-f82007ef1962', '6ff01337-e83c-49ca-a3a2-11173ce39d61', '38b1a518-fdaf-4a86-bda4-6e582d831079', '64a6fc4f-34fd-46b7-bd76-18ebdade9ef4'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:56:25 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-e9b738af-ad39-4a6b-95b7-53873178dd18 tempest-VolumesSnapshotListTestJSON-446835402 None] Delete snapshot completed successfully. Apr 24 13:56:25 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e9b738af-ad39-4a6b-95b7-53873178dd18 tempest-VolumesSnapshotListTestJSON-446835402 None] Lock "cinder-81ae9f96-2034-48bc-b956-4a284f2e84e2-delete_snapshot" released by "delete_snapshot" :: held 2.615s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:56:25 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-3ef845a3-24d1-405d-a9e6-5de22fa86f30 tempest-VolumesSnapshotListTestJSON-446835402 None] Acquiring lock "cinder-5df30407-b975-4c98-8565-afc2e65ba5c2-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:56:25 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-3ef845a3-24d1-405d-a9e6-5de22fa86f30 tempest-VolumesSnapshotListTestJSON-446835402 None] Lock "cinder-5df30407-b975-4c98-8565-afc2e65ba5c2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:56:25 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-3ef845a3-24d1-405d-a9e6-5de22fa86f30 tempest-VolumesSnapshotListTestJSON-446835402 None] Acquiring lock "cinder-quobyte-5df30407-b975-4c98-8565-afc2e65ba5c2" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:56:25 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-3ef845a3-24d1-405d-a9e6-5de22fa86f30 tempest-VolumesSnapshotListTestJSON-446835402 None] Lock "cinder-quobyte-5df30407-b975-4c98-8565-afc2e65ba5c2" acquired by "delete_volume" :: waited 0.017s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:56:25 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b64b586-7906-4748-9ebc-a65b7aedcbe0]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:56:25 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3ef845a3-24d1-405d-a9e6-5de22fa86f30 tempest-VolumesSnapshotListTestJSON-446835402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:25 devstack sudo[90324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2 Apr 24 13:56:25 devstack sudo[90324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:26 devstack sudo[90324]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3ef845a3-24d1-405d-a9e6-5de22fa86f30 tempest-VolumesSnapshotListTestJSON-446835402 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2" returned: 0 in 0.533s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3ef845a3-24d1-405d-a9e6-5de22fa86f30 tempest-VolumesSnapshotListTestJSON-446835402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:26 devstack sudo[90329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2 Apr 24 13:56:26 devstack sudo[90329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:26 devstack sudo[90329]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3ef845a3-24d1-405d-a9e6-5de22fa86f30 tempest-VolumesSnapshotListTestJSON-446835402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-5df30407-b975-4c98-8565-afc2e65ba5c2" returned: 0 in 0.496s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:26 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-3ef845a3-24d1-405d-a9e6-5de22fa86f30 tempest-VolumesSnapshotListTestJSON-446835402 None] Lock "cinder-quobyte-5df30407-b975-4c98-8565-afc2e65ba5c2" released by "delete_volume" :: held 1.090s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:56:26 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-3ef845a3-24d1-405d-a9e6-5de22fa86f30 tempest-VolumesSnapshotListTestJSON-446835402 None] Created reservations ['2f4ee536-2e3c-40b1-a43c-467bb7fc146f', '65be843a-0ed8-4d4b-b2e2-b2d024fdc5a6', '8bd82c8f-0a17-4b6f-aa5b-65bdf35057bf', '57013337-2e60-4114-a98c-23e83b4ee504'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:56:27 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-3ef845a3-24d1-405d-a9e6-5de22fa86f30 tempest-VolumesSnapshotListTestJSON-446835402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:56:27 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-3ef845a3-24d1-405d-a9e6-5de22fa86f30 tempest-VolumesSnapshotListTestJSON-446835402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:56:27 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-3ef845a3-24d1-405d-a9e6-5de22fa86f30 tempest-VolumesSnapshotListTestJSON-446835402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:56:27 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-3ef845a3-24d1-405d-a9e6-5de22fa86f30 tempest-VolumesSnapshotListTestJSON-446835402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:56:27 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-3ef845a3-24d1-405d-a9e6-5de22fa86f30 tempest-VolumesSnapshotListTestJSON-446835402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:56:27 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3ef845a3-24d1-405d-a9e6-5de22fa86f30 tempest-VolumesSnapshotListTestJSON-446835402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:27 devstack sudo[90332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:56:27 devstack sudo[90332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:27 devstack sudo[90332]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:27 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3ef845a3-24d1-405d-a9e6-5de22fa86f30 tempest-VolumesSnapshotListTestJSON-446835402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.515s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:27 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-3ef845a3-24d1-405d-a9e6-5de22fa86f30 tempest-VolumesSnapshotListTestJSON-446835402 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:56:27 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-3ef845a3-24d1-405d-a9e6-5de22fa86f30 tempest-VolumesSnapshotListTestJSON-446835402 None] Deleted volume successfully. Apr 24 13:56:27 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-3ef845a3-24d1-405d-a9e6-5de22fa86f30 tempest-VolumesSnapshotListTestJSON-446835402 None] Lock "cinder-5df30407-b975-4c98-8565-afc2e65ba5c2-delete_volume" released by "delete_volume" :: held 1.830s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:56:30 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2355a64-9119-45b6-85ae-6fbc3202746f tempest-CreateVolumesFromImageTest-1742342548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:56:30 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c2355a64-9119-45b6-85ae-6fbc3202746f tempest-CreateVolumesFromImageTest-1742342548 None] Flow 'volume_create_manager' (ae43a877-3618-4b15-9167-a51f6168c204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:56:30 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c2355a64-9119-45b6-85ae-6fbc3202746f tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a07cdc3-2b6b-41ec-8c5c-da2722b426a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:30 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c2355a64-9119-45b6-85ae-6fbc3202746f tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a07cdc3-2b6b-41ec-8c5c-da2722b426a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-28582874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aef8e22f-a734-43da-9543-b4316e8cc854,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0d5f69be59c40858db3b7000a78759e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:56:31Z,use_quota=True,user_id='efc5c070e8df4dda9b80bfabaa247f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:30 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c2355a64-9119-45b6-85ae-6fbc3202746f tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (107b8b4b-3a5b-4260-bebe-c9ac96a96493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:30 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c2355a64-9119-45b6-85ae-6fbc3202746f tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (107b8b4b-3a5b-4260-bebe-c9ac96a96493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:30 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c2355a64-9119-45b6-85ae-6fbc3202746f tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0301b63-60cd-443a-8dd1-d7781db3bda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:30 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c2355a64-9119-45b6-85ae-6fbc3202746f tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0301b63-60cd-443a-8dd1-d7781db3bda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aef8e22f-a734-43da-9543-b4316e8cc854', 'volume_name': 'volume-aef8e22f-a734-43da-9543-b4316e8cc854', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:30 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c2355a64-9119-45b6-85ae-6fbc3202746f tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee1b8e3f-7ecf-42e5-b856-510cf15d34a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:30 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c2355a64-9119-45b6-85ae-6fbc3202746f tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee1b8e3f-7ecf-42e5-b856-510cf15d34a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:30 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c2355a64-9119-45b6-85ae-6fbc3202746f tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79ee50cc-d620-4994-9654-cc92dadb159b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:30 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-c2355a64-9119-45b6-85ae-6fbc3202746f tempest-CreateVolumesFromImageTest-1742342548 None] Volume aef8e22f-a734-43da-9543-b4316e8cc854: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aef8e22f-a734-43da-9543-b4316e8cc854', 'volume_size': 1} Apr 24 13:56:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-c2355a64-9119-45b6-85ae-6fbc3202746f tempest-CreateVolumesFromImageTest-1742342548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:56:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-c2355a64-9119-45b6-85ae-6fbc3202746f tempest-CreateVolumesFromImageTest-1742342548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:56:30 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-c2355a64-9119-45b6-85ae-6fbc3202746f tempest-CreateVolumesFromImageTest-1742342548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-28582874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aef8e22f-a734-43da-9543-b4316e8cc854,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0d5f69be59c40858db3b7000a78759e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:56:31Z,use_quota=True,user_id='efc5c070e8df4dda9b80bfabaa247f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:56:30 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-c2355a64-9119-45b6-85ae-6fbc3202746f tempest-CreateVolumesFromImageTest-1742342548 None] Creating volume aef8e22f-a734-43da-9543-b4316e8cc854 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:56:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-c2355a64-9119-45b6-85ae-6fbc3202746f tempest-CreateVolumesFromImageTest-1742342548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:56:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-c2355a64-9119-45b6-85ae-6fbc3202746f tempest-CreateVolumesFromImageTest-1742342548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:56:30 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-c2355a64-9119-45b6-85ae-6fbc3202746f tempest-CreateVolumesFromImageTest-1742342548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:56:30 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-c2355a64-9119-45b6-85ae-6fbc3202746f tempest-CreateVolumesFromImageTest-1742342548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:56:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-c2355a64-9119-45b6-85ae-6fbc3202746f tempest-CreateVolumesFromImageTest-1742342548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:56:30 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-c2355a64-9119-45b6-85ae-6fbc3202746f tempest-CreateVolumesFromImageTest-1742342548 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:56:30 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-c2355a64-9119-45b6-85ae-6fbc3202746f tempest-CreateVolumesFromImageTest-1742342548 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:56:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-c2355a64-9119-45b6-85ae-6fbc3202746f tempest-CreateVolumesFromImageTest-1742342548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-aef8e22f-a734-43da-9543-b4316e8cc854 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:30 devstack sudo[90336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-aef8e22f-a734-43da-9543-b4316e8cc854 1073741824 Apr 24 13:56:30 devstack sudo[90336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:31 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-e02d60fb-5d02-4b64-896c-397d3f39a93a tempest-CreateVolumesFromImageTest-1742342548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:56:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e02d60fb-5d02-4b64-896c-397d3f39a93a tempest-CreateVolumesFromImageTest-1742342548 None] Flow 'volume_create_manager' (927e1fce-3282-4562-b8eb-9f90211d5530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:56:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e02d60fb-5d02-4b64-896c-397d3f39a93a tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73016faa-b052-43c2-afc4-c46cef141491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:31 devstack cinder-volume[82046]: DEBUG dbcounter [-] [82046] Writing DB stats cinder:UPDATE=92,cinder:SELECT=64,cinder:DELETE=6,cinder:INSERT=32 {{(pid=82046) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 13:56:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e02d60fb-5d02-4b64-896c-397d3f39a93a tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73016faa-b052-43c2-afc4-c46cef141491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2005521924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=071cd7bb-15ed-4442-acaa-abf25a4022e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0d5f69be59c40858db3b7000a78759e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:56:31Z,use_quota=True,user_id='efc5c070e8df4dda9b80bfabaa247f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e02d60fb-5d02-4b64-896c-397d3f39a93a tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64111499-6c71-4173-8108-c6812367c8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e02d60fb-5d02-4b64-896c-397d3f39a93a tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64111499-6c71-4173-8108-c6812367c8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e02d60fb-5d02-4b64-896c-397d3f39a93a tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6353f2a7-fc0c-43ca-b603-15eab2c922b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e02d60fb-5d02-4b64-896c-397d3f39a93a tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6353f2a7-fc0c-43ca-b603-15eab2c922b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '071cd7bb-15ed-4442-acaa-abf25a4022e6', 'volume_name': 'volume-071cd7bb-15ed-4442-acaa-abf25a4022e6', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e02d60fb-5d02-4b64-896c-397d3f39a93a tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e81d8cba-e37d-4f83-906b-750f8efc8a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e02d60fb-5d02-4b64-896c-397d3f39a93a tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e81d8cba-e37d-4f83-906b-750f8efc8a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e02d60fb-5d02-4b64-896c-397d3f39a93a tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a522e02-c184-49e2-9ece-f3b6c43faba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:31 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-e02d60fb-5d02-4b64-896c-397d3f39a93a tempest-CreateVolumesFromImageTest-1742342548 None] Volume 071cd7bb-15ed-4442-acaa-abf25a4022e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-071cd7bb-15ed-4442-acaa-abf25a4022e6', 'volume_size': 1} Apr 24 13:56:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-e02d60fb-5d02-4b64-896c-397d3f39a93a tempest-CreateVolumesFromImageTest-1742342548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:56:31 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-aac307a6-df6f-4db8-9c10-09e580950c73 tempest-CreateVolumesFromImageTest-1742342548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:56:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aac307a6-df6f-4db8-9c10-09e580950c73 tempest-CreateVolumesFromImageTest-1742342548 None] Flow 'volume_create_manager' (da9e7211-f283-4552-ac80-acfa7f321a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:56:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aac307a6-df6f-4db8-9c10-09e580950c73 tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f4b18ce-97b2-4e7b-8685-e10b741c862e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aac307a6-df6f-4db8-9c10-09e580950c73 tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f4b18ce-97b2-4e7b-8685-e10b741c862e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1705384377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=889021f2-9042-4b4d-976a-3cfa057bdc98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0d5f69be59c40858db3b7000a78759e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:56:31Z,use_quota=True,user_id='efc5c070e8df4dda9b80bfabaa247f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aac307a6-df6f-4db8-9c10-09e580950c73 tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddaff00a-2428-472b-a8c2-2de9c3b49397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aac307a6-df6f-4db8-9c10-09e580950c73 tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddaff00a-2428-472b-a8c2-2de9c3b49397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aac307a6-df6f-4db8-9c10-09e580950c73 tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (720cc3a2-77d3-4a90-a70a-963ef8114d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aac307a6-df6f-4db8-9c10-09e580950c73 tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (720cc3a2-77d3-4a90-a70a-963ef8114d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '889021f2-9042-4b4d-976a-3cfa057bdc98', 'volume_name': 'volume-889021f2-9042-4b4d-976a-3cfa057bdc98', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aac307a6-df6f-4db8-9c10-09e580950c73 tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dc42ea0-1e88-4d68-ab25-ff0907e310b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aac307a6-df6f-4db8-9c10-09e580950c73 tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dc42ea0-1e88-4d68-ab25-ff0907e310b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aac307a6-df6f-4db8-9c10-09e580950c73 tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8ac4838-5afd-4fbe-9272-32ef9f683287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:31 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-aac307a6-df6f-4db8-9c10-09e580950c73 tempest-CreateVolumesFromImageTest-1742342548 None] Volume 889021f2-9042-4b4d-976a-3cfa057bdc98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-889021f2-9042-4b4d-976a-3cfa057bdc98', 'volume_size': 1} Apr 24 13:56:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-aac307a6-df6f-4db8-9c10-09e580950c73 tempest-CreateVolumesFromImageTest-1742342548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:56:31 devstack sudo[90336]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-c2355a64-9119-45b6-85ae-6fbc3202746f tempest-CreateVolumesFromImageTest-1742342548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-aef8e22f-a734-43da-9543-b4316e8cc854 1073741824" returned: 0 in 0.824s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-c2355a64-9119-45b6-85ae-6fbc3202746f tempest-CreateVolumesFromImageTest-1742342548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-aef8e22f-a734-43da-9543-b4316e8cc854 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:31 devstack sudo[90341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-aef8e22f-a734-43da-9543-b4316e8cc854 Apr 24 13:56:31 devstack sudo[90341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:31 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0b6c335-55a3-458e-b797-07aac0e0938a tempest-CreateVolumesFromImageTest-1742342548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:56:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f0b6c335-55a3-458e-b797-07aac0e0938a tempest-CreateVolumesFromImageTest-1742342548 None] Flow 'volume_create_manager' (b4d55cb7-90e4-489b-a272-4d20faa04c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:56:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f0b6c335-55a3-458e-b797-07aac0e0938a tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b76431df-9f20-4ff7-a16e-36301cdd811c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f0b6c335-55a3-458e-b797-07aac0e0938a tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b76431df-9f20-4ff7-a16e-36301cdd811c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1572027220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=023467f4-b175-4d3e-ac19-64ab62f84bac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0d5f69be59c40858db3b7000a78759e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:56:32Z,use_quota=True,user_id='efc5c070e8df4dda9b80bfabaa247f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f0b6c335-55a3-458e-b797-07aac0e0938a tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75315d51-68a6-4cef-bb10-c37b15b88292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f0b6c335-55a3-458e-b797-07aac0e0938a tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75315d51-68a6-4cef-bb10-c37b15b88292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f0b6c335-55a3-458e-b797-07aac0e0938a tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2c11b87-020d-4571-b290-2d03bd832e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f0b6c335-55a3-458e-b797-07aac0e0938a tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2c11b87-020d-4571-b290-2d03bd832e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '023467f4-b175-4d3e-ac19-64ab62f84bac', 'volume_name': 'volume-023467f4-b175-4d3e-ac19-64ab62f84bac', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f0b6c335-55a3-458e-b797-07aac0e0938a tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27c47006-e472-4f7b-a8f5-b1316ae55305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f0b6c335-55a3-458e-b797-07aac0e0938a tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27c47006-e472-4f7b-a8f5-b1316ae55305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f0b6c335-55a3-458e-b797-07aac0e0938a tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfc87387-ab5b-46d1-b2ea-2a9b8e6c55fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:31 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-f0b6c335-55a3-458e-b797-07aac0e0938a tempest-CreateVolumesFromImageTest-1742342548 None] Volume 023467f4-b175-4d3e-ac19-64ab62f84bac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-023467f4-b175-4d3e-ac19-64ab62f84bac', 'volume_size': 1} Apr 24 13:56:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f0b6c335-55a3-458e-b797-07aac0e0938a tempest-CreateVolumesFromImageTest-1742342548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:56:32 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc89d642-37db-4eec-a081-2a7696b40a88 tempest-CreateVolumesFromImageTest-1742342548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:56:32 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-dc89d642-37db-4eec-a081-2a7696b40a88 tempest-CreateVolumesFromImageTest-1742342548 None] Flow 'volume_create_manager' (ee12d40c-e5f4-46e8-84e3-5dea8251bcdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:56:32 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-dc89d642-37db-4eec-a081-2a7696b40a88 tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbc1d206-a864-4af4-9fcd-8c5fc4073d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:32 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-dc89d642-37db-4eec-a081-2a7696b40a88 tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbc1d206-a864-4af4-9fcd-8c5fc4073d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1527934823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70d5a690-11d3-41bb-a299-d96eb8609afc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0d5f69be59c40858db3b7000a78759e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:56:32Z,use_quota=True,user_id='efc5c070e8df4dda9b80bfabaa247f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:32 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-dc89d642-37db-4eec-a081-2a7696b40a88 tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cdf2c3a-d3c9-4c9b-969f-39074f14d418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:32 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-dc89d642-37db-4eec-a081-2a7696b40a88 tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cdf2c3a-d3c9-4c9b-969f-39074f14d418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:32 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-dc89d642-37db-4eec-a081-2a7696b40a88 tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a20465b-7a38-4cbb-9747-43c8313a1f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:32 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-dc89d642-37db-4eec-a081-2a7696b40a88 tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a20465b-7a38-4cbb-9747-43c8313a1f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70d5a690-11d3-41bb-a299-d96eb8609afc', 'volume_name': 'volume-70d5a690-11d3-41bb-a299-d96eb8609afc', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:32 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-dc89d642-37db-4eec-a081-2a7696b40a88 tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37341ec8-0d66-4dc7-8bf3-3f79ca121ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:32 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-dc89d642-37db-4eec-a081-2a7696b40a88 tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37341ec8-0d66-4dc7-8bf3-3f79ca121ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:32 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-dc89d642-37db-4eec-a081-2a7696b40a88 tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32484bd7-f0a3-419c-b3db-91671456cf96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:32 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-dc89d642-37db-4eec-a081-2a7696b40a88 tempest-CreateVolumesFromImageTest-1742342548 None] Volume 70d5a690-11d3-41bb-a299-d96eb8609afc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70d5a690-11d3-41bb-a299-d96eb8609afc', 'volume_size': 1} Apr 24 13:56:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-dc89d642-37db-4eec-a081-2a7696b40a88 tempest-CreateVolumesFromImageTest-1742342548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:56:32 devstack sudo[90341]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-c2355a64-9119-45b6-85ae-6fbc3202746f tempest-CreateVolumesFromImageTest-1742342548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-aef8e22f-a734-43da-9543-b4316e8cc854" returned: 0 in 0.527s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:32 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-c2355a64-9119-45b6-85ae-6fbc3202746f tempest-CreateVolumesFromImageTest-1742342548 None] <== create_volume: return (1396ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:56:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-c2355a64-9119-45b6-85ae-6fbc3202746f tempest-CreateVolumesFromImageTest-1742342548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.399s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:56:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-e02d60fb-5d02-4b64-896c-397d3f39a93a tempest-CreateVolumesFromImageTest-1742342548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.055s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:56:32 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-e02d60fb-5d02-4b64-896c-397d3f39a93a tempest-CreateVolumesFromImageTest-1742342548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2005521924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=071cd7bb-15ed-4442-acaa-abf25a4022e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0d5f69be59c40858db3b7000a78759e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:56:31Z,use_quota=True,user_id='efc5c070e8df4dda9b80bfabaa247f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:56:32 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-e02d60fb-5d02-4b64-896c-397d3f39a93a tempest-CreateVolumesFromImageTest-1742342548 None] Creating volume 071cd7bb-15ed-4442-acaa-abf25a4022e6 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:56:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-e02d60fb-5d02-4b64-896c-397d3f39a93a tempest-CreateVolumesFromImageTest-1742342548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:56:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-e02d60fb-5d02-4b64-896c-397d3f39a93a tempest-CreateVolumesFromImageTest-1742342548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:56:32 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-e02d60fb-5d02-4b64-896c-397d3f39a93a tempest-CreateVolumesFromImageTest-1742342548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:56:32 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-e02d60fb-5d02-4b64-896c-397d3f39a93a tempest-CreateVolumesFromImageTest-1742342548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:56:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-e02d60fb-5d02-4b64-896c-397d3f39a93a tempest-CreateVolumesFromImageTest-1742342548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:56:32 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-e02d60fb-5d02-4b64-896c-397d3f39a93a tempest-CreateVolumesFromImageTest-1742342548 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:56:32 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-e02d60fb-5d02-4b64-896c-397d3f39a93a tempest-CreateVolumesFromImageTest-1742342548 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:56:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e02d60fb-5d02-4b64-896c-397d3f39a93a tempest-CreateVolumesFromImageTest-1742342548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-071cd7bb-15ed-4442-acaa-abf25a4022e6 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:32 devstack sudo[90344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-071cd7bb-15ed-4442-acaa-abf25a4022e6 1073741824 Apr 24 13:56:32 devstack sudo[90344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:32 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c2355a64-9119-45b6-85ae-6fbc3202746f tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79ee50cc-d620-4994-9654-cc92dadb159b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aef8e22f-a734-43da-9543-b4316e8cc854', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:32 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c2355a64-9119-45b6-85ae-6fbc3202746f tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c20b1e7-2c13-4302-b08b-aad394723c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:32 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-c2355a64-9119-45b6-85ae-6fbc3202746f tempest-CreateVolumesFromImageTest-1742342548 None] Volume volume-aef8e22f-a734-43da-9543-b4316e8cc854 (aef8e22f-a734-43da-9543-b4316e8cc854): created successfully Apr 24 13:56:32 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c2355a64-9119-45b6-85ae-6fbc3202746f tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c20b1e7-2c13-4302-b08b-aad394723c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:32 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-c2355a64-9119-45b6-85ae-6fbc3202746f tempest-CreateVolumesFromImageTest-1742342548 None] Flow 'volume_create_manager' (ae43a877-3618-4b15-9167-a51f6168c204) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:56:32 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-c2355a64-9119-45b6-85ae-6fbc3202746f tempest-CreateVolumesFromImageTest-1742342548 None] Created volume successfully. Apr 24 13:56:33 devstack sudo[90344]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e02d60fb-5d02-4b64-896c-397d3f39a93a tempest-CreateVolumesFromImageTest-1742342548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-071cd7bb-15ed-4442-acaa-abf25a4022e6 1073741824" returned: 0 in 0.702s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e02d60fb-5d02-4b64-896c-397d3f39a93a tempest-CreateVolumesFromImageTest-1742342548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-071cd7bb-15ed-4442-acaa-abf25a4022e6 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:33 devstack sudo[90350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-071cd7bb-15ed-4442-acaa-abf25a4022e6 Apr 24 13:56:33 devstack sudo[90350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:33 devstack sudo[90350]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e02d60fb-5d02-4b64-896c-397d3f39a93a tempest-CreateVolumesFromImageTest-1742342548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-071cd7bb-15ed-4442-acaa-abf25a4022e6" returned: 0 in 0.491s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:33 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-e02d60fb-5d02-4b64-896c-397d3f39a93a tempest-CreateVolumesFromImageTest-1742342548 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:56:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-e02d60fb-5d02-4b64-896c-397d3f39a93a tempest-CreateVolumesFromImageTest-1742342548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:56:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-aac307a6-df6f-4db8-9c10-09e580950c73 tempest-CreateVolumesFromImageTest-1742342548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.914s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:56:33 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-aac307a6-df6f-4db8-9c10-09e580950c73 tempest-CreateVolumesFromImageTest-1742342548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1705384377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=889021f2-9042-4b4d-976a-3cfa057bdc98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0d5f69be59c40858db3b7000a78759e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:56:31Z,use_quota=True,user_id='efc5c070e8df4dda9b80bfabaa247f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:56:33 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-aac307a6-df6f-4db8-9c10-09e580950c73 tempest-CreateVolumesFromImageTest-1742342548 None] Creating volume 889021f2-9042-4b4d-976a-3cfa057bdc98 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:56:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-aac307a6-df6f-4db8-9c10-09e580950c73 tempest-CreateVolumesFromImageTest-1742342548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:56:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-aac307a6-df6f-4db8-9c10-09e580950c73 tempest-CreateVolumesFromImageTest-1742342548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:56:33 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-aac307a6-df6f-4db8-9c10-09e580950c73 tempest-CreateVolumesFromImageTest-1742342548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:56:33 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-aac307a6-df6f-4db8-9c10-09e580950c73 tempest-CreateVolumesFromImageTest-1742342548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:56:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-aac307a6-df6f-4db8-9c10-09e580950c73 tempest-CreateVolumesFromImageTest-1742342548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:56:33 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-aac307a6-df6f-4db8-9c10-09e580950c73 tempest-CreateVolumesFromImageTest-1742342548 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:56:33 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-aac307a6-df6f-4db8-9c10-09e580950c73 tempest-CreateVolumesFromImageTest-1742342548 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:56:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-aac307a6-df6f-4db8-9c10-09e580950c73 tempest-CreateVolumesFromImageTest-1742342548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-889021f2-9042-4b4d-976a-3cfa057bdc98 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:33 devstack sudo[90354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-889021f2-9042-4b4d-976a-3cfa057bdc98 1073741824 Apr 24 13:56:33 devstack sudo[90354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:33 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e02d60fb-5d02-4b64-896c-397d3f39a93a tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a522e02-c184-49e2-9ece-f3b6c43faba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-071cd7bb-15ed-4442-acaa-abf25a4022e6', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:33 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e02d60fb-5d02-4b64-896c-397d3f39a93a tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e168c63e-b8ed-4d29-bf03-f9583973f239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:33 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-e02d60fb-5d02-4b64-896c-397d3f39a93a tempest-CreateVolumesFromImageTest-1742342548 None] Volume volume-071cd7bb-15ed-4442-acaa-abf25a4022e6 (071cd7bb-15ed-4442-acaa-abf25a4022e6): created successfully Apr 24 13:56:33 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e02d60fb-5d02-4b64-896c-397d3f39a93a tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e168c63e-b8ed-4d29-bf03-f9583973f239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:33 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e02d60fb-5d02-4b64-896c-397d3f39a93a tempest-CreateVolumesFromImageTest-1742342548 None] Flow 'volume_create_manager' (927e1fce-3282-4562-b8eb-9f90211d5530) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:56:33 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-e02d60fb-5d02-4b64-896c-397d3f39a93a tempest-CreateVolumesFromImageTest-1742342548 None] Created volume successfully. Apr 24 13:56:34 devstack sudo[90354]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-aac307a6-df6f-4db8-9c10-09e580950c73 tempest-CreateVolumesFromImageTest-1742342548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-889021f2-9042-4b4d-976a-3cfa057bdc98 1073741824" returned: 0 in 0.726s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-aac307a6-df6f-4db8-9c10-09e580950c73 tempest-CreateVolumesFromImageTest-1742342548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-889021f2-9042-4b4d-976a-3cfa057bdc98 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:34 devstack sudo[90359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-889021f2-9042-4b4d-976a-3cfa057bdc98 Apr 24 13:56:34 devstack sudo[90359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:34 devstack sudo[90359]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-aac307a6-df6f-4db8-9c10-09e580950c73 tempest-CreateVolumesFromImageTest-1742342548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-889021f2-9042-4b4d-976a-3cfa057bdc98" returned: 0 in 0.461s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:34 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-aac307a6-df6f-4db8-9c10-09e580950c73 tempest-CreateVolumesFromImageTest-1742342548 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:56:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-aac307a6-df6f-4db8-9c10-09e580950c73 tempest-CreateVolumesFromImageTest-1742342548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.232s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:56:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f0b6c335-55a3-458e-b797-07aac0e0938a tempest-CreateVolumesFromImageTest-1742342548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.874s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:56:34 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-f0b6c335-55a3-458e-b797-07aac0e0938a tempest-CreateVolumesFromImageTest-1742342548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1572027220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=023467f4-b175-4d3e-ac19-64ab62f84bac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0d5f69be59c40858db3b7000a78759e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:56:32Z,use_quota=True,user_id='efc5c070e8df4dda9b80bfabaa247f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:56:34 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-f0b6c335-55a3-458e-b797-07aac0e0938a tempest-CreateVolumesFromImageTest-1742342548 None] Creating volume 023467f4-b175-4d3e-ac19-64ab62f84bac {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:56:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f0b6c335-55a3-458e-b797-07aac0e0938a tempest-CreateVolumesFromImageTest-1742342548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:56:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f0b6c335-55a3-458e-b797-07aac0e0938a tempest-CreateVolumesFromImageTest-1742342548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:56:34 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-f0b6c335-55a3-458e-b797-07aac0e0938a tempest-CreateVolumesFromImageTest-1742342548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:56:34 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-f0b6c335-55a3-458e-b797-07aac0e0938a tempest-CreateVolumesFromImageTest-1742342548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:56:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f0b6c335-55a3-458e-b797-07aac0e0938a tempest-CreateVolumesFromImageTest-1742342548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:56:34 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-f0b6c335-55a3-458e-b797-07aac0e0938a tempest-CreateVolumesFromImageTest-1742342548 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:56:34 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-f0b6c335-55a3-458e-b797-07aac0e0938a tempest-CreateVolumesFromImageTest-1742342548 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:56:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f0b6c335-55a3-458e-b797-07aac0e0938a tempest-CreateVolumesFromImageTest-1742342548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-023467f4-b175-4d3e-ac19-64ab62f84bac 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:34 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aac307a6-df6f-4db8-9c10-09e580950c73 tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8ac4838-5afd-4fbe-9272-32ef9f683287) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-889021f2-9042-4b4d-976a-3cfa057bdc98', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:34 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aac307a6-df6f-4db8-9c10-09e580950c73 tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1fc1230-3338-4aae-aeb3-b96ac4f265a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:34 devstack sudo[90362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-023467f4-b175-4d3e-ac19-64ab62f84bac 1073741824 Apr 24 13:56:34 devstack sudo[90362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:34 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-aac307a6-df6f-4db8-9c10-09e580950c73 tempest-CreateVolumesFromImageTest-1742342548 None] Volume volume-889021f2-9042-4b4d-976a-3cfa057bdc98 (889021f2-9042-4b4d-976a-3cfa057bdc98): created successfully Apr 24 13:56:34 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aac307a6-df6f-4db8-9c10-09e580950c73 tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1fc1230-3338-4aae-aeb3-b96ac4f265a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:34 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aac307a6-df6f-4db8-9c10-09e580950c73 tempest-CreateVolumesFromImageTest-1742342548 None] Flow 'volume_create_manager' (da9e7211-f283-4552-ac80-acfa7f321a3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:56:34 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-aac307a6-df6f-4db8-9c10-09e580950c73 tempest-CreateVolumesFromImageTest-1742342548 None] Created volume successfully. Apr 24 13:56:35 devstack sudo[90362]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f0b6c335-55a3-458e-b797-07aac0e0938a tempest-CreateVolumesFromImageTest-1742342548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-023467f4-b175-4d3e-ac19-64ab62f84bac 1073741824" returned: 0 in 0.699s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f0b6c335-55a3-458e-b797-07aac0e0938a tempest-CreateVolumesFromImageTest-1742342548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-023467f4-b175-4d3e-ac19-64ab62f84bac {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:35 devstack sudo[90367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-023467f4-b175-4d3e-ac19-64ab62f84bac Apr 24 13:56:35 devstack sudo[90367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:36 devstack sudo[90367]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f0b6c335-55a3-458e-b797-07aac0e0938a tempest-CreateVolumesFromImageTest-1742342548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-023467f4-b175-4d3e-ac19-64ab62f84bac" returned: 0 in 0.490s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:36 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-f0b6c335-55a3-458e-b797-07aac0e0938a tempest-CreateVolumesFromImageTest-1742342548 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:56:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f0b6c335-55a3-458e-b797-07aac0e0938a tempest-CreateVolumesFromImageTest-1742342548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:56:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-dc89d642-37db-4eec-a081-2a7696b40a88 tempest-CreateVolumesFromImageTest-1742342548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.808s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:56:36 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-dc89d642-37db-4eec-a081-2a7696b40a88 tempest-CreateVolumesFromImageTest-1742342548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1527934823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70d5a690-11d3-41bb-a299-d96eb8609afc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0d5f69be59c40858db3b7000a78759e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:56:32Z,use_quota=True,user_id='efc5c070e8df4dda9b80bfabaa247f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:56:36 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-dc89d642-37db-4eec-a081-2a7696b40a88 tempest-CreateVolumesFromImageTest-1742342548 None] Creating volume 70d5a690-11d3-41bb-a299-d96eb8609afc {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:56:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-dc89d642-37db-4eec-a081-2a7696b40a88 tempest-CreateVolumesFromImageTest-1742342548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:56:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-dc89d642-37db-4eec-a081-2a7696b40a88 tempest-CreateVolumesFromImageTest-1742342548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:56:36 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-dc89d642-37db-4eec-a081-2a7696b40a88 tempest-CreateVolumesFromImageTest-1742342548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:56:36 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-dc89d642-37db-4eec-a081-2a7696b40a88 tempest-CreateVolumesFromImageTest-1742342548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:56:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-dc89d642-37db-4eec-a081-2a7696b40a88 tempest-CreateVolumesFromImageTest-1742342548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:56:36 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-dc89d642-37db-4eec-a081-2a7696b40a88 tempest-CreateVolumesFromImageTest-1742342548 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:56:36 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-dc89d642-37db-4eec-a081-2a7696b40a88 tempest-CreateVolumesFromImageTest-1742342548 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:56:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-dc89d642-37db-4eec-a081-2a7696b40a88 tempest-CreateVolumesFromImageTest-1742342548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-70d5a690-11d3-41bb-a299-d96eb8609afc 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:36 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f0b6c335-55a3-458e-b797-07aac0e0938a tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfc87387-ab5b-46d1-b2ea-2a9b8e6c55fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-023467f4-b175-4d3e-ac19-64ab62f84bac', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:36 devstack sudo[90371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-70d5a690-11d3-41bb-a299-d96eb8609afc 1073741824 Apr 24 13:56:36 devstack sudo[90371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:36 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f0b6c335-55a3-458e-b797-07aac0e0938a tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afd0bc27-29ea-4ade-bfd7-181e7a61c8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:36 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-f0b6c335-55a3-458e-b797-07aac0e0938a tempest-CreateVolumesFromImageTest-1742342548 None] Volume volume-023467f4-b175-4d3e-ac19-64ab62f84bac (023467f4-b175-4d3e-ac19-64ab62f84bac): created successfully Apr 24 13:56:36 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f0b6c335-55a3-458e-b797-07aac0e0938a tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afd0bc27-29ea-4ade-bfd7-181e7a61c8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:36 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f0b6c335-55a3-458e-b797-07aac0e0938a tempest-CreateVolumesFromImageTest-1742342548 None] Flow 'volume_create_manager' (b4d55cb7-90e4-489b-a272-4d20faa04c7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:56:36 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-f0b6c335-55a3-458e-b797-07aac0e0938a tempest-CreateVolumesFromImageTest-1742342548 None] Created volume successfully. Apr 24 13:56:36 devstack sudo[90371]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-dc89d642-37db-4eec-a081-2a7696b40a88 tempest-CreateVolumesFromImageTest-1742342548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-70d5a690-11d3-41bb-a299-d96eb8609afc 1073741824" returned: 0 in 0.736s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-dc89d642-37db-4eec-a081-2a7696b40a88 tempest-CreateVolumesFromImageTest-1742342548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-70d5a690-11d3-41bb-a299-d96eb8609afc {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:36 devstack sudo[90376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-70d5a690-11d3-41bb-a299-d96eb8609afc Apr 24 13:56:36 devstack sudo[90376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:37 devstack sudo[90376]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-dc89d642-37db-4eec-a081-2a7696b40a88 tempest-CreateVolumesFromImageTest-1742342548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-70d5a690-11d3-41bb-a299-d96eb8609afc" returned: 0 in 0.519s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:37 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-dc89d642-37db-4eec-a081-2a7696b40a88 tempest-CreateVolumesFromImageTest-1742342548 None] <== create_volume: return (1292ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:56:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-dc89d642-37db-4eec-a081-2a7696b40a88 tempest-CreateVolumesFromImageTest-1742342548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:56:37 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-dc89d642-37db-4eec-a081-2a7696b40a88 tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32484bd7-f0a3-419c-b3db-91671456cf96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70d5a690-11d3-41bb-a299-d96eb8609afc', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:37 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-dc89d642-37db-4eec-a081-2a7696b40a88 tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec3dd1f6-e327-43e2-a72f-20b4f094d94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:37 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-dc89d642-37db-4eec-a081-2a7696b40a88 tempest-CreateVolumesFromImageTest-1742342548 None] Volume volume-70d5a690-11d3-41bb-a299-d96eb8609afc (70d5a690-11d3-41bb-a299-d96eb8609afc): created successfully Apr 24 13:56:37 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-dc89d642-37db-4eec-a081-2a7696b40a88 tempest-CreateVolumesFromImageTest-1742342548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec3dd1f6-e327-43e2-a72f-20b4f094d94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:37 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-dc89d642-37db-4eec-a081-2a7696b40a88 tempest-CreateVolumesFromImageTest-1742342548 None] Flow 'volume_create_manager' (ee12d40c-e5f4-46e8-84e3-5dea8251bcdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:56:37 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-dc89d642-37db-4eec-a081-2a7696b40a88 tempest-CreateVolumesFromImageTest-1742342548 None] Created volume successfully. Apr 24 13:56:37 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-92e9f40c-0fe7-48c3-97b0-f6b134217020 tempest-CreateVolumesFromImageTest-1742342548 None] Acquiring lock "cinder-70d5a690-11d3-41bb-a299-d96eb8609afc-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:56:37 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-92e9f40c-0fe7-48c3-97b0-f6b134217020 tempest-CreateVolumesFromImageTest-1742342548 None] Lock "cinder-70d5a690-11d3-41bb-a299-d96eb8609afc-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:56:37 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-92e9f40c-0fe7-48c3-97b0-f6b134217020 tempest-CreateVolumesFromImageTest-1742342548 None] Acquiring lock "cinder-quobyte-70d5a690-11d3-41bb-a299-d96eb8609afc" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:56:37 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-92e9f40c-0fe7-48c3-97b0-f6b134217020 tempest-CreateVolumesFromImageTest-1742342548 None] Lock "cinder-quobyte-70d5a690-11d3-41bb-a299-d96eb8609afc" acquired by "delete_volume" :: waited 0.020s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:56:37 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[96599aaf-80e4-45e8-8fde-fdbf94079d8d]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:56:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-92e9f40c-0fe7-48c3-97b0-f6b134217020 tempest-CreateVolumesFromImageTest-1742342548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-70d5a690-11d3-41bb-a299-d96eb8609afc {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:37 devstack cinder-volume[82046]: DEBUG oslo_service.periodic_task [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82046) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 13:56:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:56:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:56:37 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:56:37 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:56:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:56:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:37 devstack sudo[90379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-70d5a690-11d3-41bb-a299-d96eb8609afc Apr 24 13:56:37 devstack sudo[90379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:37 devstack sudo[90380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:56:37 devstack sudo[90380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:38 devstack sudo[90380]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.471s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:38 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:56:38 devstack sudo[90379]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-92e9f40c-0fe7-48c3-97b0-f6b134217020 tempest-CreateVolumesFromImageTest-1742342548 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-70d5a690-11d3-41bb-a299-d96eb8609afc" returned: 0 in 0.547s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-92e9f40c-0fe7-48c3-97b0-f6b134217020 tempest-CreateVolumesFromImageTest-1742342548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-70d5a690-11d3-41bb-a299-d96eb8609afc {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:38 devstack sudo[90387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-70d5a690-11d3-41bb-a299-d96eb8609afc Apr 24 13:56:38 devstack sudo[90387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:38 devstack sudo[90387]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-92e9f40c-0fe7-48c3-97b0-f6b134217020 tempest-CreateVolumesFromImageTest-1742342548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-70d5a690-11d3-41bb-a299-d96eb8609afc" returned: 0 in 0.457s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:38 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-92e9f40c-0fe7-48c3-97b0-f6b134217020 tempest-CreateVolumesFromImageTest-1742342548 None] Lock "cinder-quobyte-70d5a690-11d3-41bb-a299-d96eb8609afc" released by "delete_volume" :: held 1.053s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:56:38 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-92e9f40c-0fe7-48c3-97b0-f6b134217020 tempest-CreateVolumesFromImageTest-1742342548 None] Created reservations ['c310c847-4406-49f4-ae54-e06eea92748b', '04c101f9-c488-4ace-a72d-648419c7db2b', '71202945-9ff9-4359-b0c0-0be9f66d53d9', 'eae96c86-4249-47dc-b3b6-68698d1f0b67'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:56:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-92e9f40c-0fe7-48c3-97b0-f6b134217020 tempest-CreateVolumesFromImageTest-1742342548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:56:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-92e9f40c-0fe7-48c3-97b0-f6b134217020 tempest-CreateVolumesFromImageTest-1742342548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:56:38 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-92e9f40c-0fe7-48c3-97b0-f6b134217020 tempest-CreateVolumesFromImageTest-1742342548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:56:38 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-92e9f40c-0fe7-48c3-97b0-f6b134217020 tempest-CreateVolumesFromImageTest-1742342548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:56:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-92e9f40c-0fe7-48c3-97b0-f6b134217020 tempest-CreateVolumesFromImageTest-1742342548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:56:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-92e9f40c-0fe7-48c3-97b0-f6b134217020 tempest-CreateVolumesFromImageTest-1742342548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:39 devstack sudo[90390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:56:39 devstack sudo[90390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:39 devstack sudo[90390]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-92e9f40c-0fe7-48c3-97b0-f6b134217020 tempest-CreateVolumesFromImageTest-1742342548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.460s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:39 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-92e9f40c-0fe7-48c3-97b0-f6b134217020 tempest-CreateVolumesFromImageTest-1742342548 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:56:39 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-92e9f40c-0fe7-48c3-97b0-f6b134217020 tempest-CreateVolumesFromImageTest-1742342548 None] Deleted volume successfully. Apr 24 13:56:39 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-92e9f40c-0fe7-48c3-97b0-f6b134217020 tempest-CreateVolumesFromImageTest-1742342548 None] Lock "cinder-70d5a690-11d3-41bb-a299-d96eb8609afc-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:56:39 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-0f0ec705-6ab2-4926-8757-980d2596ae3a tempest-CreateVolumesFromImageTest-1742342548 None] Acquiring lock "cinder-023467f4-b175-4d3e-ac19-64ab62f84bac-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:56:39 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-0f0ec705-6ab2-4926-8757-980d2596ae3a tempest-CreateVolumesFromImageTest-1742342548 None] Lock "cinder-023467f4-b175-4d3e-ac19-64ab62f84bac-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:56:40 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-0f0ec705-6ab2-4926-8757-980d2596ae3a tempest-CreateVolumesFromImageTest-1742342548 None] Acquiring lock "cinder-quobyte-023467f4-b175-4d3e-ac19-64ab62f84bac" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:56:40 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-0f0ec705-6ab2-4926-8757-980d2596ae3a tempest-CreateVolumesFromImageTest-1742342548 None] Lock "cinder-quobyte-023467f4-b175-4d3e-ac19-64ab62f84bac" acquired by "delete_volume" :: waited 0.017s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:56:40 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[335d2f6a-24aa-4557-b339-e614927eb7e2]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:56:40 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0f0ec705-6ab2-4926-8757-980d2596ae3a tempest-CreateVolumesFromImageTest-1742342548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-023467f4-b175-4d3e-ac19-64ab62f84bac {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:40 devstack sudo[90393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-023467f4-b175-4d3e-ac19-64ab62f84bac Apr 24 13:56:40 devstack sudo[90393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:40 devstack sudo[90393]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:40 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0f0ec705-6ab2-4926-8757-980d2596ae3a tempest-CreateVolumesFromImageTest-1742342548 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-023467f4-b175-4d3e-ac19-64ab62f84bac" returned: 0 in 0.584s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:40 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0f0ec705-6ab2-4926-8757-980d2596ae3a tempest-CreateVolumesFromImageTest-1742342548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-023467f4-b175-4d3e-ac19-64ab62f84bac {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:40 devstack sudo[90399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-023467f4-b175-4d3e-ac19-64ab62f84bac Apr 24 13:56:40 devstack sudo[90399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:41 devstack sudo[90399]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0f0ec705-6ab2-4926-8757-980d2596ae3a tempest-CreateVolumesFromImageTest-1742342548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-023467f4-b175-4d3e-ac19-64ab62f84bac" returned: 0 in 0.505s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:41 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-0f0ec705-6ab2-4926-8757-980d2596ae3a tempest-CreateVolumesFromImageTest-1742342548 None] Lock "cinder-quobyte-023467f4-b175-4d3e-ac19-64ab62f84bac" released by "delete_volume" :: held 1.131s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:56:41 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-0f0ec705-6ab2-4926-8757-980d2596ae3a tempest-CreateVolumesFromImageTest-1742342548 None] Created reservations ['cdb71250-fd48-4a03-85ae-b5570be05a4f', '7b879091-d56f-4df6-937a-0e85b49ad495', '8d316dcb-fac6-4373-b31e-3cfa26ccb287', '048622c1-e0a1-4c75-8e92-dadde891446b'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:56:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0f0ec705-6ab2-4926-8757-980d2596ae3a tempest-CreateVolumesFromImageTest-1742342548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:56:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0f0ec705-6ab2-4926-8757-980d2596ae3a tempest-CreateVolumesFromImageTest-1742342548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:56:41 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-0f0ec705-6ab2-4926-8757-980d2596ae3a tempest-CreateVolumesFromImageTest-1742342548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:56:41 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-0f0ec705-6ab2-4926-8757-980d2596ae3a tempest-CreateVolumesFromImageTest-1742342548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:56:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0f0ec705-6ab2-4926-8757-980d2596ae3a tempest-CreateVolumesFromImageTest-1742342548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:56:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0f0ec705-6ab2-4926-8757-980d2596ae3a tempest-CreateVolumesFromImageTest-1742342548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:41 devstack sudo[90402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:56:41 devstack sudo[90402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:41 devstack sudo[90402]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0f0ec705-6ab2-4926-8757-980d2596ae3a tempest-CreateVolumesFromImageTest-1742342548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.453s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:41 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-0f0ec705-6ab2-4926-8757-980d2596ae3a tempest-CreateVolumesFromImageTest-1742342548 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:56:41 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-0f0ec705-6ab2-4926-8757-980d2596ae3a tempest-CreateVolumesFromImageTest-1742342548 None] Deleted volume successfully. Apr 24 13:56:41 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-0f0ec705-6ab2-4926-8757-980d2596ae3a tempest-CreateVolumesFromImageTest-1742342548 None] Lock "cinder-023467f4-b175-4d3e-ac19-64ab62f84bac-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:56:42 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-f663ab95-867b-4b8c-86e0-ded50c3794ca tempest-CreateVolumesFromImageTest-1742342548 None] Acquiring lock "cinder-889021f2-9042-4b4d-976a-3cfa057bdc98-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:56:42 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-f663ab95-867b-4b8c-86e0-ded50c3794ca tempest-CreateVolumesFromImageTest-1742342548 None] Lock "cinder-889021f2-9042-4b4d-976a-3cfa057bdc98-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:56:42 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-f663ab95-867b-4b8c-86e0-ded50c3794ca tempest-CreateVolumesFromImageTest-1742342548 None] Acquiring lock "cinder-quobyte-889021f2-9042-4b4d-976a-3cfa057bdc98" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:56:42 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-f663ab95-867b-4b8c-86e0-ded50c3794ca tempest-CreateVolumesFromImageTest-1742342548 None] Lock "cinder-quobyte-889021f2-9042-4b4d-976a-3cfa057bdc98" acquired by "delete_volume" :: waited 0.015s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:56:42 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[5495f737-4ea5-4f47-bc32-2bb2f94cfde8]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:56:42 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f663ab95-867b-4b8c-86e0-ded50c3794ca tempest-CreateVolumesFromImageTest-1742342548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-889021f2-9042-4b4d-976a-3cfa057bdc98 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:42 devstack sudo[90405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-889021f2-9042-4b4d-976a-3cfa057bdc98 Apr 24 13:56:42 devstack sudo[90405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:42 devstack sudo[90405]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:42 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f663ab95-867b-4b8c-86e0-ded50c3794ca tempest-CreateVolumesFromImageTest-1742342548 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-889021f2-9042-4b4d-976a-3cfa057bdc98" returned: 0 in 0.522s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:42 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f663ab95-867b-4b8c-86e0-ded50c3794ca tempest-CreateVolumesFromImageTest-1742342548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-889021f2-9042-4b4d-976a-3cfa057bdc98 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:42 devstack sudo[90410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-889021f2-9042-4b4d-976a-3cfa057bdc98 Apr 24 13:56:42 devstack sudo[90410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:43 devstack sudo[90410]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f663ab95-867b-4b8c-86e0-ded50c3794ca tempest-CreateVolumesFromImageTest-1742342548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-889021f2-9042-4b4d-976a-3cfa057bdc98" returned: 0 in 0.475s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:43 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-f663ab95-867b-4b8c-86e0-ded50c3794ca tempest-CreateVolumesFromImageTest-1742342548 None] Lock "cinder-quobyte-889021f2-9042-4b4d-976a-3cfa057bdc98" released by "delete_volume" :: held 1.045s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:56:43 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-f663ab95-867b-4b8c-86e0-ded50c3794ca tempest-CreateVolumesFromImageTest-1742342548 None] Created reservations ['456ccd66-b794-4e60-b527-2d29b9eaf23a', '24f333dc-026f-4910-adb1-274979a7310b', '74298b25-278d-4d51-bf1b-7ea87fe0ce6d', 'd0e3b26f-432e-47c8-a848-c5fcecbc2b88'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:56:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f663ab95-867b-4b8c-86e0-ded50c3794ca tempest-CreateVolumesFromImageTest-1742342548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:56:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f663ab95-867b-4b8c-86e0-ded50c3794ca tempest-CreateVolumesFromImageTest-1742342548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:56:43 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-f663ab95-867b-4b8c-86e0-ded50c3794ca tempest-CreateVolumesFromImageTest-1742342548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:56:43 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-f663ab95-867b-4b8c-86e0-ded50c3794ca tempest-CreateVolumesFromImageTest-1742342548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:56:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f663ab95-867b-4b8c-86e0-ded50c3794ca tempest-CreateVolumesFromImageTest-1742342548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:56:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f663ab95-867b-4b8c-86e0-ded50c3794ca tempest-CreateVolumesFromImageTest-1742342548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:43 devstack sudo[90413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:56:43 devstack sudo[90413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:43 devstack sudo[90413]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f663ab95-867b-4b8c-86e0-ded50c3794ca tempest-CreateVolumesFromImageTest-1742342548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.442s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:43 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-f663ab95-867b-4b8c-86e0-ded50c3794ca tempest-CreateVolumesFromImageTest-1742342548 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:56:43 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-f663ab95-867b-4b8c-86e0-ded50c3794ca tempest-CreateVolumesFromImageTest-1742342548 None] Deleted volume successfully. Apr 24 13:56:43 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-f663ab95-867b-4b8c-86e0-ded50c3794ca tempest-CreateVolumesFromImageTest-1742342548 None] Lock "cinder-889021f2-9042-4b4d-976a-3cfa057bdc98-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:56:44 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-199a7335-12f1-47a9-aa9e-2c643c9ce562 tempest-CreateVolumesFromImageTest-1742342548 None] Acquiring lock "cinder-071cd7bb-15ed-4442-acaa-abf25a4022e6-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:56:44 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-199a7335-12f1-47a9-aa9e-2c643c9ce562 tempest-CreateVolumesFromImageTest-1742342548 None] Lock "cinder-071cd7bb-15ed-4442-acaa-abf25a4022e6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:56:44 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-199a7335-12f1-47a9-aa9e-2c643c9ce562 tempest-CreateVolumesFromImageTest-1742342548 None] Acquiring lock "cinder-quobyte-071cd7bb-15ed-4442-acaa-abf25a4022e6" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:56:44 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-199a7335-12f1-47a9-aa9e-2c643c9ce562 tempest-CreateVolumesFromImageTest-1742342548 None] Lock "cinder-quobyte-071cd7bb-15ed-4442-acaa-abf25a4022e6" acquired by "delete_volume" :: waited 0.018s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:56:44 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73b9bff-a243-466e-b779-4915ec7b5817]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:56:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-199a7335-12f1-47a9-aa9e-2c643c9ce562 tempest-CreateVolumesFromImageTest-1742342548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-071cd7bb-15ed-4442-acaa-abf25a4022e6 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:44 devstack sudo[90416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-071cd7bb-15ed-4442-acaa-abf25a4022e6 Apr 24 13:56:44 devstack sudo[90416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:45 devstack sudo[90416]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-199a7335-12f1-47a9-aa9e-2c643c9ce562 tempest-CreateVolumesFromImageTest-1742342548 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-071cd7bb-15ed-4442-acaa-abf25a4022e6" returned: 0 in 0.568s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-199a7335-12f1-47a9-aa9e-2c643c9ce562 tempest-CreateVolumesFromImageTest-1742342548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-071cd7bb-15ed-4442-acaa-abf25a4022e6 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:45 devstack sudo[90421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-071cd7bb-15ed-4442-acaa-abf25a4022e6 Apr 24 13:56:45 devstack sudo[90421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:45 devstack sudo[90421]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-199a7335-12f1-47a9-aa9e-2c643c9ce562 tempest-CreateVolumesFromImageTest-1742342548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-071cd7bb-15ed-4442-acaa-abf25a4022e6" returned: 0 in 0.469s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:45 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-199a7335-12f1-47a9-aa9e-2c643c9ce562 tempest-CreateVolumesFromImageTest-1742342548 None] Lock "cinder-quobyte-071cd7bb-15ed-4442-acaa-abf25a4022e6" released by "delete_volume" :: held 1.078s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:56:45 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-199a7335-12f1-47a9-aa9e-2c643c9ce562 tempest-CreateVolumesFromImageTest-1742342548 None] Created reservations ['b1c25462-1fa2-4b86-80c8-6097a36c40a5', '93721019-c72e-4ad7-aade-d5f9926cabcb', 'b39e9366-3b10-4576-b4cc-b1684693fc97', 'cc2b0484-5fb4-41b3-85cc-aba4a79fb949'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:56:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-199a7335-12f1-47a9-aa9e-2c643c9ce562 tempest-CreateVolumesFromImageTest-1742342548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:56:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-199a7335-12f1-47a9-aa9e-2c643c9ce562 tempest-CreateVolumesFromImageTest-1742342548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:56:45 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-199a7335-12f1-47a9-aa9e-2c643c9ce562 tempest-CreateVolumesFromImageTest-1742342548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:56:45 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-199a7335-12f1-47a9-aa9e-2c643c9ce562 tempest-CreateVolumesFromImageTest-1742342548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:56:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-199a7335-12f1-47a9-aa9e-2c643c9ce562 tempest-CreateVolumesFromImageTest-1742342548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:56:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-199a7335-12f1-47a9-aa9e-2c643c9ce562 tempest-CreateVolumesFromImageTest-1742342548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:45 devstack sudo[90426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:56:45 devstack sudo[90426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:46 devstack sudo[90426]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:46 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-199a7335-12f1-47a9-aa9e-2c643c9ce562 tempest-CreateVolumesFromImageTest-1742342548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.442s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:46 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-199a7335-12f1-47a9-aa9e-2c643c9ce562 tempest-CreateVolumesFromImageTest-1742342548 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:56:46 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-199a7335-12f1-47a9-aa9e-2c643c9ce562 tempest-CreateVolumesFromImageTest-1742342548 None] Deleted volume successfully. Apr 24 13:56:46 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-199a7335-12f1-47a9-aa9e-2c643c9ce562 tempest-CreateVolumesFromImageTest-1742342548 None] Lock "cinder-071cd7bb-15ed-4442-acaa-abf25a4022e6-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:56:46 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-5ad299cd-2393-4eff-a115-0d27bd7d0388 tempest-CreateVolumesFromImageTest-1742342548 None] Acquiring lock "cinder-aef8e22f-a734-43da-9543-b4316e8cc854-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:56:46 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-5ad299cd-2393-4eff-a115-0d27bd7d0388 tempest-CreateVolumesFromImageTest-1742342548 None] Lock "cinder-aef8e22f-a734-43da-9543-b4316e8cc854-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:56:46 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-5ad299cd-2393-4eff-a115-0d27bd7d0388 tempest-CreateVolumesFromImageTest-1742342548 None] Acquiring lock "cinder-quobyte-aef8e22f-a734-43da-9543-b4316e8cc854" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:56:46 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-5ad299cd-2393-4eff-a115-0d27bd7d0388 tempest-CreateVolumesFromImageTest-1742342548 None] Lock "cinder-quobyte-aef8e22f-a734-43da-9543-b4316e8cc854" acquired by "delete_volume" :: waited 0.014s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:56:46 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5193e69-c065-477f-af0e-173be017bcc0]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:56:46 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ad299cd-2393-4eff-a115-0d27bd7d0388 tempest-CreateVolumesFromImageTest-1742342548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-aef8e22f-a734-43da-9543-b4316e8cc854 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:46 devstack sudo[90429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-aef8e22f-a734-43da-9543-b4316e8cc854 Apr 24 13:56:46 devstack sudo[90429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:47 devstack sudo[90429]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ad299cd-2393-4eff-a115-0d27bd7d0388 tempest-CreateVolumesFromImageTest-1742342548 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-aef8e22f-a734-43da-9543-b4316e8cc854" returned: 0 in 0.552s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ad299cd-2393-4eff-a115-0d27bd7d0388 tempest-CreateVolumesFromImageTest-1742342548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-aef8e22f-a734-43da-9543-b4316e8cc854 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:47 devstack sudo[90434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-aef8e22f-a734-43da-9543-b4316e8cc854 Apr 24 13:56:47 devstack sudo[90434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:47 devstack sudo[90434]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ad299cd-2393-4eff-a115-0d27bd7d0388 tempest-CreateVolumesFromImageTest-1742342548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-aef8e22f-a734-43da-9543-b4316e8cc854" returned: 0 in 0.443s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:47 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-5ad299cd-2393-4eff-a115-0d27bd7d0388 tempest-CreateVolumesFromImageTest-1742342548 None] Lock "cinder-quobyte-aef8e22f-a734-43da-9543-b4316e8cc854" released by "delete_volume" :: held 1.041s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:56:47 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-5ad299cd-2393-4eff-a115-0d27bd7d0388 tempest-CreateVolumesFromImageTest-1742342548 None] Created reservations ['72646d6f-35f3-42df-92a8-5beabfc53053', '4a04836d-fc61-4f94-a727-a89866d528f9', 'dacdbc17-213c-4f46-9877-6c01f6c744c2', 'ce599441-82d6-4061-993b-17cb31831cb1'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:56:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5ad299cd-2393-4eff-a115-0d27bd7d0388 tempest-CreateVolumesFromImageTest-1742342548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:56:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5ad299cd-2393-4eff-a115-0d27bd7d0388 tempest-CreateVolumesFromImageTest-1742342548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:56:47 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-5ad299cd-2393-4eff-a115-0d27bd7d0388 tempest-CreateVolumesFromImageTest-1742342548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:56:47 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-5ad299cd-2393-4eff-a115-0d27bd7d0388 tempest-CreateVolumesFromImageTest-1742342548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:56:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5ad299cd-2393-4eff-a115-0d27bd7d0388 tempest-CreateVolumesFromImageTest-1742342548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:56:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ad299cd-2393-4eff-a115-0d27bd7d0388 tempest-CreateVolumesFromImageTest-1742342548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:47 devstack sudo[90437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:56:47 devstack sudo[90437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:48 devstack sudo[90437]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ad299cd-2393-4eff-a115-0d27bd7d0388 tempest-CreateVolumesFromImageTest-1742342548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.439s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:48 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-5ad299cd-2393-4eff-a115-0d27bd7d0388 tempest-CreateVolumesFromImageTest-1742342548 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:56:48 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-5ad299cd-2393-4eff-a115-0d27bd7d0388 tempest-CreateVolumesFromImageTest-1742342548 None] Deleted volume successfully. Apr 24 13:56:48 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-5ad299cd-2393-4eff-a115-0d27bd7d0388 tempest-CreateVolumesFromImageTest-1742342548 None] Lock "cinder-aef8e22f-a734-43da-9543-b4316e8cc854-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:56:51 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd046668-c10d-473f-bb3d-54ab8e3d3583 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:56:51 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-dd046668-c10d-473f-bb3d-54ab8e3d3583 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Flow 'volume_create_manager' (0352a01e-6544-44be-99a4-7e6da9222090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:56:51 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-dd046668-c10d-473f-bb3d-54ab8e3d3583 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (278f5001-26c7-4a0c-89a3-93275b68425a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:51 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-dd046668-c10d-473f-bb3d-54ab8e3d3583 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (278f5001-26c7-4a0c-89a3-93275b68425a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1601955428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fca13286-d5e9-4835-a9aa-db392c6e0787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18f0770420fd4f049336fbf13862a25b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:56:51Z,use_quota=True,user_id='de6647151b0640e8a798d053b5c55d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:51 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-dd046668-c10d-473f-bb3d-54ab8e3d3583 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7730b7bf-1609-4479-8431-464a281c0db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:51 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-dd046668-c10d-473f-bb3d-54ab8e3d3583 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7730b7bf-1609-4479-8431-464a281c0db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:51 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-dd046668-c10d-473f-bb3d-54ab8e3d3583 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dbade7f-ee05-429a-b74a-87c8df88f5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:51 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-dd046668-c10d-473f-bb3d-54ab8e3d3583 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dbade7f-ee05-429a-b74a-87c8df88f5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fca13286-d5e9-4835-a9aa-db392c6e0787', 'volume_name': 'volume-fca13286-d5e9-4835-a9aa-db392c6e0787', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:51 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-dd046668-c10d-473f-bb3d-54ab8e3d3583 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcff54cc-3a6d-4a9d-8edf-5e631b7e5cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:51 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-dd046668-c10d-473f-bb3d-54ab8e3d3583 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcff54cc-3a6d-4a9d-8edf-5e631b7e5cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:51 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-dd046668-c10d-473f-bb3d-54ab8e3d3583 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5615302e-dc43-4ec8-ade0-820f97dd5fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:51 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-dd046668-c10d-473f-bb3d-54ab8e3d3583 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Volume fca13286-d5e9-4835-a9aa-db392c6e0787: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fca13286-d5e9-4835-a9aa-db392c6e0787', 'volume_size': 1} Apr 24 13:56:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-dd046668-c10d-473f-bb3d-54ab8e3d3583 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:56:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-dd046668-c10d-473f-bb3d-54ab8e3d3583 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:56:51 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-dd046668-c10d-473f-bb3d-54ab8e3d3583 tempest-CreateVolumesFromSnapshotTest-1996309303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1601955428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fca13286-d5e9-4835-a9aa-db392c6e0787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18f0770420fd4f049336fbf13862a25b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:56:51Z,use_quota=True,user_id='de6647151b0640e8a798d053b5c55d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:56:51 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-dd046668-c10d-473f-bb3d-54ab8e3d3583 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Creating volume fca13286-d5e9-4835-a9aa-db392c6e0787 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:56:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-dd046668-c10d-473f-bb3d-54ab8e3d3583 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:56:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-dd046668-c10d-473f-bb3d-54ab8e3d3583 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:56:51 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-dd046668-c10d-473f-bb3d-54ab8e3d3583 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:56:51 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-dd046668-c10d-473f-bb3d-54ab8e3d3583 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:56:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-dd046668-c10d-473f-bb3d-54ab8e3d3583 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:56:51 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-dd046668-c10d-473f-bb3d-54ab8e3d3583 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:56:51 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-dd046668-c10d-473f-bb3d-54ab8e3d3583 tempest-CreateVolumesFromSnapshotTest-1996309303 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:56:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-dd046668-c10d-473f-bb3d-54ab8e3d3583 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-fca13286-d5e9-4835-a9aa-db392c6e0787 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:51 devstack sudo[90446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-fca13286-d5e9-4835-a9aa-db392c6e0787 1073741824 Apr 24 13:56:51 devstack sudo[90446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:52 devstack sudo[90446]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:52 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-dd046668-c10d-473f-bb3d-54ab8e3d3583 tempest-CreateVolumesFromSnapshotTest-1996309303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-fca13286-d5e9-4835-a9aa-db392c6e0787 1073741824" returned: 0 in 0.599s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:52 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-dd046668-c10d-473f-bb3d-54ab8e3d3583 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-fca13286-d5e9-4835-a9aa-db392c6e0787 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:52 devstack sudo[90451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-fca13286-d5e9-4835-a9aa-db392c6e0787 Apr 24 13:56:52 devstack sudo[90451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:52 devstack sudo[90451]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:52 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-dd046668-c10d-473f-bb3d-54ab8e3d3583 tempest-CreateVolumesFromSnapshotTest-1996309303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-fca13286-d5e9-4835-a9aa-db392c6e0787" returned: 0 in 0.445s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:52 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-dd046668-c10d-473f-bb3d-54ab8e3d3583 tempest-CreateVolumesFromSnapshotTest-1996309303 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:56:52 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-dd046668-c10d-473f-bb3d-54ab8e3d3583 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:56:52 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-dd046668-c10d-473f-bb3d-54ab8e3d3583 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5615302e-dc43-4ec8-ade0-820f97dd5fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fca13286-d5e9-4835-a9aa-db392c6e0787', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:52 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-dd046668-c10d-473f-bb3d-54ab8e3d3583 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a84e4063-bdcc-4c09-b6c9-9b977838c2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:52 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-dd046668-c10d-473f-bb3d-54ab8e3d3583 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Volume volume-fca13286-d5e9-4835-a9aa-db392c6e0787 (fca13286-d5e9-4835-a9aa-db392c6e0787): created successfully Apr 24 13:56:52 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-dd046668-c10d-473f-bb3d-54ab8e3d3583 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a84e4063-bdcc-4c09-b6c9-9b977838c2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:52 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-dd046668-c10d-473f-bb3d-54ab8e3d3583 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Flow 'volume_create_manager' (0352a01e-6544-44be-99a4-7e6da9222090) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:56:52 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-dd046668-c10d-473f-bb3d-54ab8e3d3583 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Created volume successfully. Apr 24 13:56:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5ffc1090-ff82-48bf-8b91-141298d92a50 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:56:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5ffc1090-ff82-48bf-8b91-141298d92a50 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:56:53 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-5ffc1090-ff82-48bf-8b91-141298d92a50 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Creating offline snapshot 15e1cf9d-e701-42eb-81b1-e4b9d288dbea of volume fca13286-d5e9-4835-a9aa-db392c6e0787 {{(pid=82046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 13:56:53 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafa2d31-a06c-4d07-a15d-5f23a2a0b43c]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:56:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ffc1090-ff82-48bf-8b91-141298d92a50 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-fca13286-d5e9-4835-a9aa-db392c6e0787 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:53 devstack sudo[90454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-fca13286-d5e9-4835-a9aa-db392c6e0787 Apr 24 13:56:53 devstack sudo[90454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:54 devstack sudo[90454]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:54 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ffc1090-ff82-48bf-8b91-141298d92a50 tempest-CreateVolumesFromSnapshotTest-1996309303 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-fca13286-d5e9-4835-a9aa-db392c6e0787" returned: 0 in 0.542s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:54 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ffc1090-ff82-48bf-8b91-141298d92a50 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-fca13286-d5e9-4835-a9aa-db392c6e0787,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-fca13286-d5e9-4835-a9aa-db392c6e0787.15e1cf9d-e701-42eb-81b1-e4b9d288dbea 1G {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:54 devstack sudo[90459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-fca13286-d5e9-4835-a9aa-db392c6e0787,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-fca13286-d5e9-4835-a9aa-db392c6e0787.15e1cf9d-e701-42eb-81b1-e4b9d288dbea 1G Apr 24 13:56:54 devstack sudo[90459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:55 devstack sudo[90459]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:55 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ffc1090-ff82-48bf-8b91-141298d92a50 tempest-CreateVolumesFromSnapshotTest-1996309303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-fca13286-d5e9-4835-a9aa-db392c6e0787,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-fca13286-d5e9-4835-a9aa-db392c6e0787.15e1cf9d-e701-42eb-81b1-e4b9d288dbea 1G" returned: 0 in 0.644s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:55 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ffc1090-ff82-48bf-8b91-141298d92a50 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fca13286-d5e9-4835-a9aa-db392c6e0787 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-fca13286-d5e9-4835-a9aa-db392c6e0787.15e1cf9d-e701-42eb-81b1-e4b9d288dbea {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:55 devstack sudo[90464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fca13286-d5e9-4835-a9aa-db392c6e0787 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-fca13286-d5e9-4835-a9aa-db392c6e0787.15e1cf9d-e701-42eb-81b1-e4b9d288dbea Apr 24 13:56:55 devstack sudo[90464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:55 devstack sudo[90464]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:55 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ffc1090-ff82-48bf-8b91-141298d92a50 tempest-CreateVolumesFromSnapshotTest-1996309303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fca13286-d5e9-4835-a9aa-db392c6e0787 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-fca13286-d5e9-4835-a9aa-db392c6e0787.15e1cf9d-e701-42eb-81b1-e4b9d288dbea" returned: 0 in 0.502s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:55 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-5ffc1090-ff82-48bf-8b91-141298d92a50 tempest-CreateVolumesFromSnapshotTest-1996309303 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-fca13286-d5e9-4835-a9aa-db392c6e0787.15e1cf9d-e701-42eb-81b1-e4b9d288dbea is being set with open permissions: ugo+rw Apr 24 13:56:55 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ffc1090-ff82-48bf-8b91-141298d92a50 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-fca13286-d5e9-4835-a9aa-db392c6e0787.15e1cf9d-e701-42eb-81b1-e4b9d288dbea {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:55 devstack sudo[90469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-fca13286-d5e9-4835-a9aa-db392c6e0787.15e1cf9d-e701-42eb-81b1-e4b9d288dbea Apr 24 13:56:55 devstack sudo[90469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:56 devstack sudo[90469]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:56 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ffc1090-ff82-48bf-8b91-141298d92a50 tempest-CreateVolumesFromSnapshotTest-1996309303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-fca13286-d5e9-4835-a9aa-db392c6e0787.15e1cf9d-e701-42eb-81b1-e4b9d288dbea" returned: 0 in 0.522s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:56 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ffc1090-ff82-48bf-8b91-141298d92a50 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-fca13286-d5e9-4835-a9aa-db392c6e0787.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:56 devstack sudo[90473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-fca13286-d5e9-4835-a9aa-db392c6e0787.info Apr 24 13:56:56 devstack sudo[90473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:56 devstack sudo[90473]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:56 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ffc1090-ff82-48bf-8b91-141298d92a50 tempest-CreateVolumesFromSnapshotTest-1996309303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-fca13286-d5e9-4835-a9aa-db392c6e0787.info" returned: 0 in 0.468s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:56 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-5ffc1090-ff82-48bf-8b91-141298d92a50 tempest-CreateVolumesFromSnapshotTest-1996309303 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-fca13286-d5e9-4835-a9aa-db392c6e0787.info is being set with open permissions: ugo+rw Apr 24 13:56:56 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ffc1090-ff82-48bf-8b91-141298d92a50 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-fca13286-d5e9-4835-a9aa-db392c6e0787.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:56 devstack sudo[90476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-fca13286-d5e9-4835-a9aa-db392c6e0787.info Apr 24 13:56:56 devstack sudo[90476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:57 devstack sudo[90476]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:57 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ffc1090-ff82-48bf-8b91-141298d92a50 tempest-CreateVolumesFromSnapshotTest-1996309303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-fca13286-d5e9-4835-a9aa-db392c6e0787.info" returned: 0 in 0.469s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:57 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5ffc1090-ff82-48bf-8b91-141298d92a50 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.236s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:56:57 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-5ffc1090-ff82-48bf-8b91-141298d92a50 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Create snapshot completed successfully Apr 24 13:56:58 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-d78c4471-2857-48e0-9650-118d4023bf6b tempest-CreateVolumesFromSnapshotTest-1996309303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:56:58 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d78c4471-2857-48e0-9650-118d4023bf6b tempest-CreateVolumesFromSnapshotTest-1996309303 None] Flow 'volume_create_manager' (f9feeb88-e87a-4062-a50e-5532ebe4f965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:56:58 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d78c4471-2857-48e0-9650-118d4023bf6b tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd247290-0d84-4201-9005-d71e33bde610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:58 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d78c4471-2857-48e0-9650-118d4023bf6b tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd247290-0d84-4201-9005-d71e33bde610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-512900251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6094012-6584-42de-aabe-b3c6f8c39094,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18f0770420fd4f049336fbf13862a25b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:56:58Z,use_quota=True,user_id='de6647151b0640e8a798d053b5c55d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:58 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d78c4471-2857-48e0-9650-118d4023bf6b tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (121333da-b4e7-4915-8e91-f85189082d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:58 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d78c4471-2857-48e0-9650-118d4023bf6b tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (121333da-b4e7-4915-8e91-f85189082d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:58 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d78c4471-2857-48e0-9650-118d4023bf6b tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3097f1db-1f81-49ec-9862-710764fb0b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:58 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d78c4471-2857-48e0-9650-118d4023bf6b tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3097f1db-1f81-49ec-9862-710764fb0b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6094012-6584-42de-aabe-b3c6f8c39094', 'volume_name': 'volume-b6094012-6584-42de-aabe-b3c6f8c39094', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:58 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d78c4471-2857-48e0-9650-118d4023bf6b tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f096141-b734-45bf-9583-155fb05eacbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:58 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d78c4471-2857-48e0-9650-118d4023bf6b tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f096141-b734-45bf-9583-155fb05eacbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:58 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d78c4471-2857-48e0-9650-118d4023bf6b tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f53a4f16-4c69-4404-a444-b21261fffcd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:58 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-d78c4471-2857-48e0-9650-118d4023bf6b tempest-CreateVolumesFromSnapshotTest-1996309303 None] Volume b6094012-6584-42de-aabe-b3c6f8c39094: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6094012-6584-42de-aabe-b3c6f8c39094', 'volume_size': 1} Apr 24 13:56:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d78c4471-2857-48e0-9650-118d4023bf6b tempest-CreateVolumesFromSnapshotTest-1996309303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:56:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d78c4471-2857-48e0-9650-118d4023bf6b tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:56:58 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-d78c4471-2857-48e0-9650-118d4023bf6b tempest-CreateVolumesFromSnapshotTest-1996309303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-512900251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6094012-6584-42de-aabe-b3c6f8c39094,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18f0770420fd4f049336fbf13862a25b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:56:58Z,use_quota=True,user_id='de6647151b0640e8a798d053b5c55d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:56:58 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-d78c4471-2857-48e0-9650-118d4023bf6b tempest-CreateVolumesFromSnapshotTest-1996309303 None] Creating volume b6094012-6584-42de-aabe-b3c6f8c39094 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:56:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d78c4471-2857-48e0-9650-118d4023bf6b tempest-CreateVolumesFromSnapshotTest-1996309303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:56:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d78c4471-2857-48e0-9650-118d4023bf6b tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:56:58 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-d78c4471-2857-48e0-9650-118d4023bf6b tempest-CreateVolumesFromSnapshotTest-1996309303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:56:58 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-d78c4471-2857-48e0-9650-118d4023bf6b tempest-CreateVolumesFromSnapshotTest-1996309303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:56:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d78c4471-2857-48e0-9650-118d4023bf6b tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:56:58 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-d78c4471-2857-48e0-9650-118d4023bf6b tempest-CreateVolumesFromSnapshotTest-1996309303 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:56:58 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-d78c4471-2857-48e0-9650-118d4023bf6b tempest-CreateVolumesFromSnapshotTest-1996309303 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:56:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d78c4471-2857-48e0-9650-118d4023bf6b tempest-CreateVolumesFromSnapshotTest-1996309303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b6094012-6584-42de-aabe-b3c6f8c39094 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:58 devstack sudo[90479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b6094012-6584-42de-aabe-b3c6f8c39094 1073741824 Apr 24 13:56:58 devstack sudo[90479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:58 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-f09fb7eb-334e-422e-8a08-48bc5dab8de7 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:56:58 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f09fb7eb-334e-422e-8a08-48bc5dab8de7 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Flow 'volume_create_manager' (748d3ab3-36f8-463e-91e5-cca1a5b1f589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:56:58 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f09fb7eb-334e-422e-8a08-48bc5dab8de7 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbf9c505-e42a-43d1-b6a2-894ca07d056a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:58 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f09fb7eb-334e-422e-8a08-48bc5dab8de7 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbf9c505-e42a-43d1-b6a2-894ca07d056a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-388968542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b7be9cf-39c7-476d-8bdc-49045a38b532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18f0770420fd4f049336fbf13862a25b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:56:59Z,use_quota=True,user_id='de6647151b0640e8a798d053b5c55d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:58 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f09fb7eb-334e-422e-8a08-48bc5dab8de7 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af036607-e1e2-4ed9-87bd-a64af4d3ce3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:58 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f09fb7eb-334e-422e-8a08-48bc5dab8de7 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af036607-e1e2-4ed9-87bd-a64af4d3ce3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:58 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f09fb7eb-334e-422e-8a08-48bc5dab8de7 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c7d1529-e677-455e-a28a-08391e86883f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:58 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f09fb7eb-334e-422e-8a08-48bc5dab8de7 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c7d1529-e677-455e-a28a-08391e86883f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b7be9cf-39c7-476d-8bdc-49045a38b532', 'volume_name': 'volume-4b7be9cf-39c7-476d-8bdc-49045a38b532', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:58 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f09fb7eb-334e-422e-8a08-48bc5dab8de7 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46e7a291-4524-4f13-ad40-19250cb9b4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:58 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f09fb7eb-334e-422e-8a08-48bc5dab8de7 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46e7a291-4524-4f13-ad40-19250cb9b4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:58 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f09fb7eb-334e-422e-8a08-48bc5dab8de7 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2e6d2dd-cee8-49b9-9b51-65fa17b0d547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:58 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-f09fb7eb-334e-422e-8a08-48bc5dab8de7 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Volume 4b7be9cf-39c7-476d-8bdc-49045a38b532: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b7be9cf-39c7-476d-8bdc-49045a38b532', 'volume_size': 1} Apr 24 13:56:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f09fb7eb-334e-422e-8a08-48bc5dab8de7 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-d18d5c79-c63e-477d-9c8e-0cf3aad5ee63 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d18d5c79-c63e-477d-9c8e-0cf3aad5ee63 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Flow 'volume_create_manager' (0b90a48e-6571-44fb-a229-ef3638393f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d18d5c79-c63e-477d-9c8e-0cf3aad5ee63 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e48f6202-3d47-41a3-b05d-e70b72abb4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d18d5c79-c63e-477d-9c8e-0cf3aad5ee63 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e48f6202-3d47-41a3-b05d-e70b72abb4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1815841568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=127cea97-2cc0-431a-8dcc-03fbff478755,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18f0770420fd4f049336fbf13862a25b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:56:59Z,use_quota=True,user_id='de6647151b0640e8a798d053b5c55d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d18d5c79-c63e-477d-9c8e-0cf3aad5ee63 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fcfc618-5424-4875-9f6e-646d4cf8b4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d18d5c79-c63e-477d-9c8e-0cf3aad5ee63 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fcfc618-5424-4875-9f6e-646d4cf8b4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d18d5c79-c63e-477d-9c8e-0cf3aad5ee63 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6955d5f7-f079-41fa-b98c-b7fcc060b84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d18d5c79-c63e-477d-9c8e-0cf3aad5ee63 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6955d5f7-f079-41fa-b98c-b7fcc060b84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '127cea97-2cc0-431a-8dcc-03fbff478755', 'volume_name': 'volume-127cea97-2cc0-431a-8dcc-03fbff478755', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d18d5c79-c63e-477d-9c8e-0cf3aad5ee63 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0386c4e-db57-4432-99da-9a3f331986e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d18d5c79-c63e-477d-9c8e-0cf3aad5ee63 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0386c4e-db57-4432-99da-9a3f331986e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d18d5c79-c63e-477d-9c8e-0cf3aad5ee63 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cf09e62-3236-4e2d-9a11-abf79c467897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:59 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-d18d5c79-c63e-477d-9c8e-0cf3aad5ee63 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Volume 127cea97-2cc0-431a-8dcc-03fbff478755: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-127cea97-2cc0-431a-8dcc-03fbff478755', 'volume_size': 1} Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d18d5c79-c63e-477d-9c8e-0cf3aad5ee63 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:56:59 devstack sudo[90479]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d78c4471-2857-48e0-9650-118d4023bf6b tempest-CreateVolumesFromSnapshotTest-1996309303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b6094012-6584-42de-aabe-b3c6f8c39094 1073741824" returned: 0 in 0.828s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d78c4471-2857-48e0-9650-118d4023bf6b tempest-CreateVolumesFromSnapshotTest-1996309303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b6094012-6584-42de-aabe-b3c6f8c39094 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-f263a3ba-0f7a-44b0-a996-9e0d19c03c95 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:56:59 devstack sudo[90484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b6094012-6584-42de-aabe-b3c6f8c39094 Apr 24 13:56:59 devstack sudo[90484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f263a3ba-0f7a-44b0-a996-9e0d19c03c95 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Flow 'volume_create_manager' (0f4648be-f69b-4c35-8e5d-65ff70874912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f263a3ba-0f7a-44b0-a996-9e0d19c03c95 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab3f5b6e-aabc-4a26-94c2-4bf247e560b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f263a3ba-0f7a-44b0-a996-9e0d19c03c95 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab3f5b6e-aabc-4a26-94c2-4bf247e560b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-788587636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a48f5c1-824a-4904-9d96-4cd25dc8d289,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18f0770420fd4f049336fbf13862a25b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:56:59Z,use_quota=True,user_id='de6647151b0640e8a798d053b5c55d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f263a3ba-0f7a-44b0-a996-9e0d19c03c95 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57b98643-4743-470d-b9b5-c05c81343b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f263a3ba-0f7a-44b0-a996-9e0d19c03c95 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57b98643-4743-470d-b9b5-c05c81343b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f263a3ba-0f7a-44b0-a996-9e0d19c03c95 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f14f9328-bc4e-44aa-9465-07a8171cb212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f263a3ba-0f7a-44b0-a996-9e0d19c03c95 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f14f9328-bc4e-44aa-9465-07a8171cb212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a48f5c1-824a-4904-9d96-4cd25dc8d289', 'volume_name': 'volume-2a48f5c1-824a-4904-9d96-4cd25dc8d289', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f263a3ba-0f7a-44b0-a996-9e0d19c03c95 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2a2d5f9-fb2b-4ee7-b96a-5816a61442b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f263a3ba-0f7a-44b0-a996-9e0d19c03c95 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2a2d5f9-fb2b-4ee7-b96a-5816a61442b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f263a3ba-0f7a-44b0-a996-9e0d19c03c95 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37bbaf83-0b79-4527-a95a-0f70d32bfa2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:59 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-f263a3ba-0f7a-44b0-a996-9e0d19c03c95 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Volume 2a48f5c1-824a-4904-9d96-4cd25dc8d289: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a48f5c1-824a-4904-9d96-4cd25dc8d289', 'volume_size': 1} Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f263a3ba-0f7a-44b0-a996-9e0d19c03c95 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-061f7fc6-733b-4fd9-9351-311068677dce tempest-CreateVolumesFromSnapshotTest-1996309303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-061f7fc6-733b-4fd9-9351-311068677dce tempest-CreateVolumesFromSnapshotTest-1996309303 None] Flow 'volume_create_manager' (bea32e57-d2d0-4cb0-ae8c-56088d58ce63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-061f7fc6-733b-4fd9-9351-311068677dce tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c512c09f-38d3-452e-839a-4ba2720710b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-061f7fc6-733b-4fd9-9351-311068677dce tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c512c09f-38d3-452e-839a-4ba2720710b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1097458685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8a24dc9-9fdd-4154-b01d-1ebd1d263cb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18f0770420fd4f049336fbf13862a25b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:57:00Z,use_quota=True,user_id='de6647151b0640e8a798d053b5c55d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-061f7fc6-733b-4fd9-9351-311068677dce tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (532a6c23-3bb2-4480-b35d-94423af159fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-061f7fc6-733b-4fd9-9351-311068677dce tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (532a6c23-3bb2-4480-b35d-94423af159fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-061f7fc6-733b-4fd9-9351-311068677dce tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (872bb826-0ad4-49b5-bf20-5a27430eb978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-061f7fc6-733b-4fd9-9351-311068677dce tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (872bb826-0ad4-49b5-bf20-5a27430eb978) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8a24dc9-9fdd-4154-b01d-1ebd1d263cb4', 'volume_name': 'volume-d8a24dc9-9fdd-4154-b01d-1ebd1d263cb4', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-061f7fc6-733b-4fd9-9351-311068677dce tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (636493d8-b4c7-406e-9f17-3bceeb61faca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-061f7fc6-733b-4fd9-9351-311068677dce tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (636493d8-b4c7-406e-9f17-3bceeb61faca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-061f7fc6-733b-4fd9-9351-311068677dce tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (956b5823-7b4e-49a1-b255-f8c66b89be3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:59 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-061f7fc6-733b-4fd9-9351-311068677dce tempest-CreateVolumesFromSnapshotTest-1996309303 None] Volume d8a24dc9-9fdd-4154-b01d-1ebd1d263cb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8a24dc9-9fdd-4154-b01d-1ebd1d263cb4', 'volume_size': 1} Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-061f7fc6-733b-4fd9-9351-311068677dce tempest-CreateVolumesFromSnapshotTest-1996309303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:56:59 devstack sudo[90484]: pam_unix(sudo:session): session closed for user root Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d78c4471-2857-48e0-9650-118d4023bf6b tempest-CreateVolumesFromSnapshotTest-1996309303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b6094012-6584-42de-aabe-b3c6f8c39094" returned: 0 in 0.531s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-d78c4471-2857-48e0-9650-118d4023bf6b tempest-CreateVolumesFromSnapshotTest-1996309303 None] <== create_volume: return (1421ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d78c4471-2857-48e0-9650-118d4023bf6b tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.423s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f09fb7eb-334e-422e-8a08-48bc5dab8de7 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.070s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-f09fb7eb-334e-422e-8a08-48bc5dab8de7 tempest-CreateVolumesFromSnapshotTest-1996309303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-388968542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b7be9cf-39c7-476d-8bdc-49045a38b532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18f0770420fd4f049336fbf13862a25b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:56:59Z,use_quota=True,user_id='de6647151b0640e8a798d053b5c55d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-f09fb7eb-334e-422e-8a08-48bc5dab8de7 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Creating volume 4b7be9cf-39c7-476d-8bdc-49045a38b532 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f09fb7eb-334e-422e-8a08-48bc5dab8de7 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f09fb7eb-334e-422e-8a08-48bc5dab8de7 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-f09fb7eb-334e-422e-8a08-48bc5dab8de7 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-f09fb7eb-334e-422e-8a08-48bc5dab8de7 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f09fb7eb-334e-422e-8a08-48bc5dab8de7 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-f09fb7eb-334e-422e-8a08-48bc5dab8de7 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:56:59 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-f09fb7eb-334e-422e-8a08-48bc5dab8de7 tempest-CreateVolumesFromSnapshotTest-1996309303 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f09fb7eb-334e-422e-8a08-48bc5dab8de7 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4b7be9cf-39c7-476d-8bdc-49045a38b532 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:56:59 devstack sudo[90487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4b7be9cf-39c7-476d-8bdc-49045a38b532 1073741824 Apr 24 13:56:59 devstack sudo[90487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d78c4471-2857-48e0-9650-118d4023bf6b tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f53a4f16-4c69-4404-a444-b21261fffcd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6094012-6584-42de-aabe-b3c6f8c39094', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d78c4471-2857-48e0-9650-118d4023bf6b tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7a2d1a2-5797-499b-ba96-359279ab2bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:56:59 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-d78c4471-2857-48e0-9650-118d4023bf6b tempest-CreateVolumesFromSnapshotTest-1996309303 None] Volume volume-b6094012-6584-42de-aabe-b3c6f8c39094 (b6094012-6584-42de-aabe-b3c6f8c39094): created successfully Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d78c4471-2857-48e0-9650-118d4023bf6b tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7a2d1a2-5797-499b-ba96-359279ab2bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:56:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d78c4471-2857-48e0-9650-118d4023bf6b tempest-CreateVolumesFromSnapshotTest-1996309303 None] Flow 'volume_create_manager' (f9feeb88-e87a-4062-a50e-5532ebe4f965) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:56:59 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-d78c4471-2857-48e0-9650-118d4023bf6b tempest-CreateVolumesFromSnapshotTest-1996309303 None] Created volume successfully. Apr 24 13:57:00 devstack sudo[90487]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:00 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f09fb7eb-334e-422e-8a08-48bc5dab8de7 tempest-CreateVolumesFromSnapshotTest-1996309303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4b7be9cf-39c7-476d-8bdc-49045a38b532 1073741824" returned: 0 in 0.652s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:00 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f09fb7eb-334e-422e-8a08-48bc5dab8de7 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4b7be9cf-39c7-476d-8bdc-49045a38b532 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:00 devstack sudo[90492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4b7be9cf-39c7-476d-8bdc-49045a38b532 Apr 24 13:57:00 devstack sudo[90492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:01 devstack sudo[90492]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f09fb7eb-334e-422e-8a08-48bc5dab8de7 tempest-CreateVolumesFromSnapshotTest-1996309303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4b7be9cf-39c7-476d-8bdc-49045a38b532" returned: 0 in 0.522s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:01 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-f09fb7eb-334e-422e-8a08-48bc5dab8de7 tempest-CreateVolumesFromSnapshotTest-1996309303 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:57:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f09fb7eb-334e-422e-8a08-48bc5dab8de7 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:57:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d18d5c79-c63e-477d-9c8e-0cf3aad5ee63 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.950s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:57:01 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-d18d5c79-c63e-477d-9c8e-0cf3aad5ee63 tempest-CreateVolumesFromSnapshotTest-1996309303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1815841568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=127cea97-2cc0-431a-8dcc-03fbff478755,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18f0770420fd4f049336fbf13862a25b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:56:59Z,use_quota=True,user_id='de6647151b0640e8a798d053b5c55d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:57:01 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-d18d5c79-c63e-477d-9c8e-0cf3aad5ee63 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Creating volume 127cea97-2cc0-431a-8dcc-03fbff478755 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:57:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d18d5c79-c63e-477d-9c8e-0cf3aad5ee63 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:57:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d18d5c79-c63e-477d-9c8e-0cf3aad5ee63 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:57:01 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-d18d5c79-c63e-477d-9c8e-0cf3aad5ee63 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:57:01 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-d18d5c79-c63e-477d-9c8e-0cf3aad5ee63 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:57:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d18d5c79-c63e-477d-9c8e-0cf3aad5ee63 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:57:01 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-d18d5c79-c63e-477d-9c8e-0cf3aad5ee63 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:57:01 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-d18d5c79-c63e-477d-9c8e-0cf3aad5ee63 tempest-CreateVolumesFromSnapshotTest-1996309303 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:57:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d18d5c79-c63e-477d-9c8e-0cf3aad5ee63 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-127cea97-2cc0-431a-8dcc-03fbff478755 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:01 devstack sudo[90495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-127cea97-2cc0-431a-8dcc-03fbff478755 1073741824 Apr 24 13:57:01 devstack sudo[90495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:01 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f09fb7eb-334e-422e-8a08-48bc5dab8de7 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2e6d2dd-cee8-49b9-9b51-65fa17b0d547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b7be9cf-39c7-476d-8bdc-49045a38b532', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:57:01 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f09fb7eb-334e-422e-8a08-48bc5dab8de7 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd910663-f707-40fa-a8c8-36424ede2eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:57:01 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-f09fb7eb-334e-422e-8a08-48bc5dab8de7 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Volume volume-4b7be9cf-39c7-476d-8bdc-49045a38b532 (4b7be9cf-39c7-476d-8bdc-49045a38b532): created successfully Apr 24 13:57:01 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f09fb7eb-334e-422e-8a08-48bc5dab8de7 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd910663-f707-40fa-a8c8-36424ede2eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:57:01 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f09fb7eb-334e-422e-8a08-48bc5dab8de7 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Flow 'volume_create_manager' (748d3ab3-36f8-463e-91e5-cca1a5b1f589) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:57:01 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-f09fb7eb-334e-422e-8a08-48bc5dab8de7 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Created volume successfully. Apr 24 13:57:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d18d5c79-c63e-477d-9c8e-0cf3aad5ee63 tempest-CreateVolumesFromSnapshotTest-1996309303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-127cea97-2cc0-431a-8dcc-03fbff478755 1073741824" returned: 0 in 0.660s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:01 devstack sudo[90495]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d18d5c79-c63e-477d-9c8e-0cf3aad5ee63 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-127cea97-2cc0-431a-8dcc-03fbff478755 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:01 devstack sudo[90500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-127cea97-2cc0-431a-8dcc-03fbff478755 Apr 24 13:57:01 devstack sudo[90500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:02 devstack sudo[90500]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d18d5c79-c63e-477d-9c8e-0cf3aad5ee63 tempest-CreateVolumesFromSnapshotTest-1996309303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-127cea97-2cc0-431a-8dcc-03fbff478755" returned: 0 in 0.491s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:02 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-d18d5c79-c63e-477d-9c8e-0cf3aad5ee63 tempest-CreateVolumesFromSnapshotTest-1996309303 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:57:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d18d5c79-c63e-477d-9c8e-0cf3aad5ee63 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:57:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f263a3ba-0f7a-44b0-a996-9e0d19c03c95 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.841s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:57:02 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-f263a3ba-0f7a-44b0-a996-9e0d19c03c95 tempest-CreateVolumesFromSnapshotTest-1996309303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-788587636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a48f5c1-824a-4904-9d96-4cd25dc8d289,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18f0770420fd4f049336fbf13862a25b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:56:59Z,use_quota=True,user_id='de6647151b0640e8a798d053b5c55d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:57:02 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-f263a3ba-0f7a-44b0-a996-9e0d19c03c95 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Creating volume 2a48f5c1-824a-4904-9d96-4cd25dc8d289 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:57:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f263a3ba-0f7a-44b0-a996-9e0d19c03c95 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:57:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f263a3ba-0f7a-44b0-a996-9e0d19c03c95 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:57:02 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-f263a3ba-0f7a-44b0-a996-9e0d19c03c95 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:57:02 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-f263a3ba-0f7a-44b0-a996-9e0d19c03c95 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:57:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f263a3ba-0f7a-44b0-a996-9e0d19c03c95 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:57:02 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-f263a3ba-0f7a-44b0-a996-9e0d19c03c95 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:57:02 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-f263a3ba-0f7a-44b0-a996-9e0d19c03c95 tempest-CreateVolumesFromSnapshotTest-1996309303 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:57:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f263a3ba-0f7a-44b0-a996-9e0d19c03c95 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-2a48f5c1-824a-4904-9d96-4cd25dc8d289 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:02 devstack sudo[90503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-2a48f5c1-824a-4904-9d96-4cd25dc8d289 1073741824 Apr 24 13:57:02 devstack sudo[90503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:02 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d18d5c79-c63e-477d-9c8e-0cf3aad5ee63 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cf09e62-3236-4e2d-9a11-abf79c467897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-127cea97-2cc0-431a-8dcc-03fbff478755', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:57:02 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d18d5c79-c63e-477d-9c8e-0cf3aad5ee63 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9964a7ea-42f1-49d8-a70b-5a05815d5e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:57:02 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-d18d5c79-c63e-477d-9c8e-0cf3aad5ee63 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Volume volume-127cea97-2cc0-431a-8dcc-03fbff478755 (127cea97-2cc0-431a-8dcc-03fbff478755): created successfully Apr 24 13:57:02 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d18d5c79-c63e-477d-9c8e-0cf3aad5ee63 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9964a7ea-42f1-49d8-a70b-5a05815d5e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:57:02 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-d18d5c79-c63e-477d-9c8e-0cf3aad5ee63 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Flow 'volume_create_manager' (0b90a48e-6571-44fb-a229-ef3638393f87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:57:02 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-d18d5c79-c63e-477d-9c8e-0cf3aad5ee63 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Created volume successfully. Apr 24 13:57:02 devstack sudo[90503]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f263a3ba-0f7a-44b0-a996-9e0d19c03c95 tempest-CreateVolumesFromSnapshotTest-1996309303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-2a48f5c1-824a-4904-9d96-4cd25dc8d289 1073741824" returned: 0 in 0.718s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f263a3ba-0f7a-44b0-a996-9e0d19c03c95 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-2a48f5c1-824a-4904-9d96-4cd25dc8d289 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:03 devstack sudo[90508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-2a48f5c1-824a-4904-9d96-4cd25dc8d289 Apr 24 13:57:03 devstack sudo[90508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:03 devstack sudo[90508]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-f263a3ba-0f7a-44b0-a996-9e0d19c03c95 tempest-CreateVolumesFromSnapshotTest-1996309303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-2a48f5c1-824a-4904-9d96-4cd25dc8d289" returned: 0 in 0.464s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:03 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-f263a3ba-0f7a-44b0-a996-9e0d19c03c95 tempest-CreateVolumesFromSnapshotTest-1996309303 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:57:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-f263a3ba-0f7a-44b0-a996-9e0d19c03c95 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.229s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:57:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-061f7fc6-733b-4fd9-9351-311068677dce tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.789s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:57:03 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-061f7fc6-733b-4fd9-9351-311068677dce tempest-CreateVolumesFromSnapshotTest-1996309303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1097458685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8a24dc9-9fdd-4154-b01d-1ebd1d263cb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18f0770420fd4f049336fbf13862a25b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:57:00Z,use_quota=True,user_id='de6647151b0640e8a798d053b5c55d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:57:03 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-061f7fc6-733b-4fd9-9351-311068677dce tempest-CreateVolumesFromSnapshotTest-1996309303 None] Creating volume d8a24dc9-9fdd-4154-b01d-1ebd1d263cb4 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:57:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-061f7fc6-733b-4fd9-9351-311068677dce tempest-CreateVolumesFromSnapshotTest-1996309303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:57:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-061f7fc6-733b-4fd9-9351-311068677dce tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:57:03 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-061f7fc6-733b-4fd9-9351-311068677dce tempest-CreateVolumesFromSnapshotTest-1996309303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:57:03 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-061f7fc6-733b-4fd9-9351-311068677dce tempest-CreateVolumesFromSnapshotTest-1996309303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:57:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-061f7fc6-733b-4fd9-9351-311068677dce tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:57:03 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-061f7fc6-733b-4fd9-9351-311068677dce tempest-CreateVolumesFromSnapshotTest-1996309303 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:57:03 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-061f7fc6-733b-4fd9-9351-311068677dce tempest-CreateVolumesFromSnapshotTest-1996309303 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:57:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-061f7fc6-733b-4fd9-9351-311068677dce tempest-CreateVolumesFromSnapshotTest-1996309303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d8a24dc9-9fdd-4154-b01d-1ebd1d263cb4 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:03 devstack sudo[90511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d8a24dc9-9fdd-4154-b01d-1ebd1d263cb4 1073741824 Apr 24 13:57:03 devstack sudo[90511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:03 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f263a3ba-0f7a-44b0-a996-9e0d19c03c95 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37bbaf83-0b79-4527-a95a-0f70d32bfa2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a48f5c1-824a-4904-9d96-4cd25dc8d289', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:57:03 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f263a3ba-0f7a-44b0-a996-9e0d19c03c95 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (581f1194-c12f-4585-b631-11804cfb27c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:57:03 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-f263a3ba-0f7a-44b0-a996-9e0d19c03c95 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Volume volume-2a48f5c1-824a-4904-9d96-4cd25dc8d289 (2a48f5c1-824a-4904-9d96-4cd25dc8d289): created successfully Apr 24 13:57:03 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f263a3ba-0f7a-44b0-a996-9e0d19c03c95 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (581f1194-c12f-4585-b631-11804cfb27c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:57:03 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-f263a3ba-0f7a-44b0-a996-9e0d19c03c95 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Flow 'volume_create_manager' (0f4648be-f69b-4c35-8e5d-65ff70874912) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:57:03 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-f263a3ba-0f7a-44b0-a996-9e0d19c03c95 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Created volume successfully. Apr 24 13:57:04 devstack sudo[90511]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:04 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-061f7fc6-733b-4fd9-9351-311068677dce tempest-CreateVolumesFromSnapshotTest-1996309303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d8a24dc9-9fdd-4154-b01d-1ebd1d263cb4 1073741824" returned: 0 in 0.730s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:04 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-061f7fc6-733b-4fd9-9351-311068677dce tempest-CreateVolumesFromSnapshotTest-1996309303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d8a24dc9-9fdd-4154-b01d-1ebd1d263cb4 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:04 devstack sudo[90516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d8a24dc9-9fdd-4154-b01d-1ebd1d263cb4 Apr 24 13:57:04 devstack sudo[90516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:04 devstack sudo[90516]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:04 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-061f7fc6-733b-4fd9-9351-311068677dce tempest-CreateVolumesFromSnapshotTest-1996309303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d8a24dc9-9fdd-4154-b01d-1ebd1d263cb4" returned: 0 in 0.440s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:04 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-061f7fc6-733b-4fd9-9351-311068677dce tempest-CreateVolumesFromSnapshotTest-1996309303 None] <== create_volume: return (1214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:57:04 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-061f7fc6-733b-4fd9-9351-311068677dce tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:57:04 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-061f7fc6-733b-4fd9-9351-311068677dce tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (956b5823-7b4e-49a1-b255-f8c66b89be3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8a24dc9-9fdd-4154-b01d-1ebd1d263cb4', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:57:04 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-061f7fc6-733b-4fd9-9351-311068677dce tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a86540b-15e6-410f-903c-b735634446be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:57:04 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-061f7fc6-733b-4fd9-9351-311068677dce tempest-CreateVolumesFromSnapshotTest-1996309303 None] Volume volume-d8a24dc9-9fdd-4154-b01d-1ebd1d263cb4 (d8a24dc9-9fdd-4154-b01d-1ebd1d263cb4): created successfully Apr 24 13:57:04 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-061f7fc6-733b-4fd9-9351-311068677dce tempest-CreateVolumesFromSnapshotTest-1996309303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a86540b-15e6-410f-903c-b735634446be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:57:04 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-061f7fc6-733b-4fd9-9351-311068677dce tempest-CreateVolumesFromSnapshotTest-1996309303 None] Flow 'volume_create_manager' (bea32e57-d2d0-4cb0-ae8c-56088d58ce63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:57:04 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-061f7fc6-733b-4fd9-9351-311068677dce tempest-CreateVolumesFromSnapshotTest-1996309303 None] Created volume successfully. Apr 24 13:57:05 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-2e8bd6c9-52cf-4832-a3f5-b3861e2409fc tempest-CreateVolumesFromSnapshotTest-1996309303 None] Acquiring lock "cinder-d8a24dc9-9fdd-4154-b01d-1ebd1d263cb4-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:57:05 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-2e8bd6c9-52cf-4832-a3f5-b3861e2409fc tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "cinder-d8a24dc9-9fdd-4154-b01d-1ebd1d263cb4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:57:05 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-2e8bd6c9-52cf-4832-a3f5-b3861e2409fc tempest-CreateVolumesFromSnapshotTest-1996309303 None] Acquiring lock "cinder-quobyte-d8a24dc9-9fdd-4154-b01d-1ebd1d263cb4" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:57:05 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-2e8bd6c9-52cf-4832-a3f5-b3861e2409fc tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "cinder-quobyte-d8a24dc9-9fdd-4154-b01d-1ebd1d263cb4" acquired by "delete_volume" :: waited 0.017s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:57:05 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef6450d-3ea0-4412-a851-3f21083718aa]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:57:05 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2e8bd6c9-52cf-4832-a3f5-b3861e2409fc tempest-CreateVolumesFromSnapshotTest-1996309303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d8a24dc9-9fdd-4154-b01d-1ebd1d263cb4 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:05 devstack sudo[90519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d8a24dc9-9fdd-4154-b01d-1ebd1d263cb4 Apr 24 13:57:05 devstack sudo[90519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:05 devstack sudo[90519]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:05 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2e8bd6c9-52cf-4832-a3f5-b3861e2409fc tempest-CreateVolumesFromSnapshotTest-1996309303 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d8a24dc9-9fdd-4154-b01d-1ebd1d263cb4" returned: 0 in 0.604s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:05 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2e8bd6c9-52cf-4832-a3f5-b3861e2409fc tempest-CreateVolumesFromSnapshotTest-1996309303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d8a24dc9-9fdd-4154-b01d-1ebd1d263cb4 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:05 devstack sudo[90525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d8a24dc9-9fdd-4154-b01d-1ebd1d263cb4 Apr 24 13:57:05 devstack sudo[90525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:06 devstack sudo[90525]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2e8bd6c9-52cf-4832-a3f5-b3861e2409fc tempest-CreateVolumesFromSnapshotTest-1996309303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d8a24dc9-9fdd-4154-b01d-1ebd1d263cb4" returned: 0 in 0.535s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:06 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-2e8bd6c9-52cf-4832-a3f5-b3861e2409fc tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "cinder-quobyte-d8a24dc9-9fdd-4154-b01d-1ebd1d263cb4" released by "delete_volume" :: held 1.182s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:57:06 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-2e8bd6c9-52cf-4832-a3f5-b3861e2409fc tempest-CreateVolumesFromSnapshotTest-1996309303 None] Created reservations ['cd407adf-035c-455d-a954-22f0c86d791f', 'ecca5310-244c-4549-90d9-3a242fa84bfd', '01f35558-86b2-4ffa-b366-1f9a0fbc947a', '1930b13e-a881-4741-b674-198a5fa21928'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:57:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-2e8bd6c9-52cf-4832-a3f5-b3861e2409fc tempest-CreateVolumesFromSnapshotTest-1996309303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:57:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-2e8bd6c9-52cf-4832-a3f5-b3861e2409fc tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:57:06 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-2e8bd6c9-52cf-4832-a3f5-b3861e2409fc tempest-CreateVolumesFromSnapshotTest-1996309303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:57:06 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-2e8bd6c9-52cf-4832-a3f5-b3861e2409fc tempest-CreateVolumesFromSnapshotTest-1996309303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:57:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-2e8bd6c9-52cf-4832-a3f5-b3861e2409fc tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:57:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2e8bd6c9-52cf-4832-a3f5-b3861e2409fc tempest-CreateVolumesFromSnapshotTest-1996309303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:06 devstack sudo[90528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:57:06 devstack sudo[90528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:07 devstack sudo[90528]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2e8bd6c9-52cf-4832-a3f5-b3861e2409fc tempest-CreateVolumesFromSnapshotTest-1996309303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.529s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:07 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-2e8bd6c9-52cf-4832-a3f5-b3861e2409fc tempest-CreateVolumesFromSnapshotTest-1996309303 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:57:07 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-2e8bd6c9-52cf-4832-a3f5-b3861e2409fc tempest-CreateVolumesFromSnapshotTest-1996309303 None] Deleted volume successfully. Apr 24 13:57:07 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-2e8bd6c9-52cf-4832-a3f5-b3861e2409fc tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "cinder-d8a24dc9-9fdd-4154-b01d-1ebd1d263cb4-delete_volume" released by "delete_volume" :: held 1.935s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:57:07 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-52123cd2-6495-4e29-ba15-f03bc0730858 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Acquiring lock "cinder-2a48f5c1-824a-4904-9d96-4cd25dc8d289-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:57:07 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-52123cd2-6495-4e29-ba15-f03bc0730858 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "cinder-2a48f5c1-824a-4904-9d96-4cd25dc8d289-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:57:07 devstack cinder-volume[82046]: DEBUG dbcounter [-] [82046] Writing DB stats cinder:SELECT=90,cinder:DELETE=13,cinder:UPDATE=113,cinder:INSERT=24 {{(pid=82046) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 13:57:07 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-52123cd2-6495-4e29-ba15-f03bc0730858 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Acquiring lock "cinder-quobyte-2a48f5c1-824a-4904-9d96-4cd25dc8d289" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:57:07 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-52123cd2-6495-4e29-ba15-f03bc0730858 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "cinder-quobyte-2a48f5c1-824a-4904-9d96-4cd25dc8d289" acquired by "delete_volume" :: waited 0.016s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:57:07 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a7192a-f005-4836-be56-e424f615f3e1]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:57:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-52123cd2-6495-4e29-ba15-f03bc0730858 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-2a48f5c1-824a-4904-9d96-4cd25dc8d289 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:07 devstack sudo[90531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-2a48f5c1-824a-4904-9d96-4cd25dc8d289 Apr 24 13:57:07 devstack sudo[90531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:08 devstack sudo[90531]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-52123cd2-6495-4e29-ba15-f03bc0730858 tempest-CreateVolumesFromSnapshotTest-1996309303 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-2a48f5c1-824a-4904-9d96-4cd25dc8d289" returned: 0 in 0.592s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-52123cd2-6495-4e29-ba15-f03bc0730858 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-2a48f5c1-824a-4904-9d96-4cd25dc8d289 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:08 devstack sudo[90536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-2a48f5c1-824a-4904-9d96-4cd25dc8d289 Apr 24 13:57:08 devstack sudo[90536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:08 devstack sudo[90536]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-52123cd2-6495-4e29-ba15-f03bc0730858 tempest-CreateVolumesFromSnapshotTest-1996309303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-2a48f5c1-824a-4904-9d96-4cd25dc8d289" returned: 0 in 0.548s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:08 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-52123cd2-6495-4e29-ba15-f03bc0730858 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "cinder-quobyte-2a48f5c1-824a-4904-9d96-4cd25dc8d289" released by "delete_volume" :: held 1.185s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:57:08 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-52123cd2-6495-4e29-ba15-f03bc0730858 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Created reservations ['b0ffa993-5fd8-45ee-8282-a99afe64737a', '4f595299-c669-4136-9d6c-21987772271a', '7688123c-8fc0-4672-bc24-749aaf9768c3', '0dec5180-0000-4aaa-94cb-08a071aa4a50'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:57:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-52123cd2-6495-4e29-ba15-f03bc0730858 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:57:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-52123cd2-6495-4e29-ba15-f03bc0730858 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:57:08 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-52123cd2-6495-4e29-ba15-f03bc0730858 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:57:08 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-52123cd2-6495-4e29-ba15-f03bc0730858 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:57:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-52123cd2-6495-4e29-ba15-f03bc0730858 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:57:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-52123cd2-6495-4e29-ba15-f03bc0730858 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:08 devstack sudo[90539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:57:08 devstack sudo[90539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:09 devstack sudo[90539]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-52123cd2-6495-4e29-ba15-f03bc0730858 tempest-CreateVolumesFromSnapshotTest-1996309303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.505s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:09 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-52123cd2-6495-4e29-ba15-f03bc0730858 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:57:09 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-52123cd2-6495-4e29-ba15-f03bc0730858 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Deleted volume successfully. Apr 24 13:57:09 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-52123cd2-6495-4e29-ba15-f03bc0730858 tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "cinder-2a48f5c1-824a-4904-9d96-4cd25dc8d289-delete_volume" released by "delete_volume" :: held 1.926s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:57:09 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-6b1e2470-2752-4638-8168-c4ddfc3497fb tempest-CreateVolumesFromSnapshotTest-1996309303 None] Acquiring lock "cinder-127cea97-2cc0-431a-8dcc-03fbff478755-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:57:09 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-6b1e2470-2752-4638-8168-c4ddfc3497fb tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "cinder-127cea97-2cc0-431a-8dcc-03fbff478755-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:57:09 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-6b1e2470-2752-4638-8168-c4ddfc3497fb tempest-CreateVolumesFromSnapshotTest-1996309303 None] Acquiring lock "cinder-quobyte-127cea97-2cc0-431a-8dcc-03fbff478755" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:57:09 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-6b1e2470-2752-4638-8168-c4ddfc3497fb tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "cinder-quobyte-127cea97-2cc0-431a-8dcc-03fbff478755" acquired by "delete_volume" :: waited 0.023s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:57:09 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00c388d-d290-45fc-9bb9-cfc161daf083]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:57:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6b1e2470-2752-4638-8168-c4ddfc3497fb tempest-CreateVolumesFromSnapshotTest-1996309303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-127cea97-2cc0-431a-8dcc-03fbff478755 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:09 devstack sudo[90542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-127cea97-2cc0-431a-8dcc-03fbff478755 Apr 24 13:57:09 devstack sudo[90542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:10 devstack sudo[90542]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:10 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6b1e2470-2752-4638-8168-c4ddfc3497fb tempest-CreateVolumesFromSnapshotTest-1996309303 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-127cea97-2cc0-431a-8dcc-03fbff478755" returned: 0 in 0.583s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:10 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6b1e2470-2752-4638-8168-c4ddfc3497fb tempest-CreateVolumesFromSnapshotTest-1996309303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-127cea97-2cc0-431a-8dcc-03fbff478755 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:10 devstack sudo[90547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-127cea97-2cc0-431a-8dcc-03fbff478755 Apr 24 13:57:10 devstack sudo[90547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:10 devstack sudo[90547]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:10 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6b1e2470-2752-4638-8168-c4ddfc3497fb tempest-CreateVolumesFromSnapshotTest-1996309303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-127cea97-2cc0-431a-8dcc-03fbff478755" returned: 0 in 0.533s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:11 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-6b1e2470-2752-4638-8168-c4ddfc3497fb tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "cinder-quobyte-127cea97-2cc0-431a-8dcc-03fbff478755" released by "delete_volume" :: held 1.161s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:57:11 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-6b1e2470-2752-4638-8168-c4ddfc3497fb tempest-CreateVolumesFromSnapshotTest-1996309303 None] Created reservations ['a879d9c0-c1fe-4df7-aa3e-11be2375c835', 'e9f59547-60db-4918-93cd-726176a1b2cd', '741b9345-23d3-446a-8967-163cd8687351', 'f7e0c3b2-6395-49a0-a654-dd4affdd9bd7'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:57:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-6b1e2470-2752-4638-8168-c4ddfc3497fb tempest-CreateVolumesFromSnapshotTest-1996309303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:57:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-6b1e2470-2752-4638-8168-c4ddfc3497fb tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:57:11 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-6b1e2470-2752-4638-8168-c4ddfc3497fb tempest-CreateVolumesFromSnapshotTest-1996309303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:57:11 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-6b1e2470-2752-4638-8168-c4ddfc3497fb tempest-CreateVolumesFromSnapshotTest-1996309303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:57:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-6b1e2470-2752-4638-8168-c4ddfc3497fb tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:57:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6b1e2470-2752-4638-8168-c4ddfc3497fb tempest-CreateVolumesFromSnapshotTest-1996309303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:11 devstack sudo[90550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:57:11 devstack sudo[90550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:11 devstack sudo[90550]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6b1e2470-2752-4638-8168-c4ddfc3497fb tempest-CreateVolumesFromSnapshotTest-1996309303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.497s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:11 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-6b1e2470-2752-4638-8168-c4ddfc3497fb tempest-CreateVolumesFromSnapshotTest-1996309303 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:57:11 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-6b1e2470-2752-4638-8168-c4ddfc3497fb tempest-CreateVolumesFromSnapshotTest-1996309303 None] Deleted volume successfully. Apr 24 13:57:11 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-6b1e2470-2752-4638-8168-c4ddfc3497fb tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "cinder-127cea97-2cc0-431a-8dcc-03fbff478755-delete_volume" released by "delete_volume" :: held 1.881s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:57:12 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-a12ede10-ab5d-4ad4-9583-11593fbb3dfb tempest-CreateVolumesFromSnapshotTest-1996309303 None] Acquiring lock "cinder-4b7be9cf-39c7-476d-8bdc-49045a38b532-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:57:12 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-a12ede10-ab5d-4ad4-9583-11593fbb3dfb tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "cinder-4b7be9cf-39c7-476d-8bdc-49045a38b532-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:57:12 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-a12ede10-ab5d-4ad4-9583-11593fbb3dfb tempest-CreateVolumesFromSnapshotTest-1996309303 None] Acquiring lock "cinder-quobyte-4b7be9cf-39c7-476d-8bdc-49045a38b532" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:57:12 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-a12ede10-ab5d-4ad4-9583-11593fbb3dfb tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "cinder-quobyte-4b7be9cf-39c7-476d-8bdc-49045a38b532" acquired by "delete_volume" :: waited 0.015s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:57:12 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ac11b8-f658-403b-a590-ab8feaadfd3d]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:57:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a12ede10-ab5d-4ad4-9583-11593fbb3dfb tempest-CreateVolumesFromSnapshotTest-1996309303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4b7be9cf-39c7-476d-8bdc-49045a38b532 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:12 devstack sudo[90553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4b7be9cf-39c7-476d-8bdc-49045a38b532 Apr 24 13:57:12 devstack sudo[90553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:12 devstack sudo[90553]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a12ede10-ab5d-4ad4-9583-11593fbb3dfb tempest-CreateVolumesFromSnapshotTest-1996309303 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4b7be9cf-39c7-476d-8bdc-49045a38b532" returned: 0 in 0.521s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a12ede10-ab5d-4ad4-9583-11593fbb3dfb tempest-CreateVolumesFromSnapshotTest-1996309303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4b7be9cf-39c7-476d-8bdc-49045a38b532 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:12 devstack sudo[90558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4b7be9cf-39c7-476d-8bdc-49045a38b532 Apr 24 13:57:12 devstack sudo[90558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:13 devstack sudo[90558]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a12ede10-ab5d-4ad4-9583-11593fbb3dfb tempest-CreateVolumesFromSnapshotTest-1996309303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4b7be9cf-39c7-476d-8bdc-49045a38b532" returned: 0 in 0.467s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:13 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-a12ede10-ab5d-4ad4-9583-11593fbb3dfb tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "cinder-quobyte-4b7be9cf-39c7-476d-8bdc-49045a38b532" released by "delete_volume" :: held 1.031s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:57:13 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-a12ede10-ab5d-4ad4-9583-11593fbb3dfb tempest-CreateVolumesFromSnapshotTest-1996309303 None] Created reservations ['05b80536-1404-408b-b399-05fb67586edb', '1e5bd2f9-5f73-4fc0-af6a-b345eb3f2dc9', 'e28be0bf-926f-4ce7-9ebe-83dc28585769', '5731eed1-7209-4138-8b2b-c30272dfc739'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:57:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a12ede10-ab5d-4ad4-9583-11593fbb3dfb tempest-CreateVolumesFromSnapshotTest-1996309303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:57:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a12ede10-ab5d-4ad4-9583-11593fbb3dfb tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:57:13 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a12ede10-ab5d-4ad4-9583-11593fbb3dfb tempest-CreateVolumesFromSnapshotTest-1996309303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:57:13 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a12ede10-ab5d-4ad4-9583-11593fbb3dfb tempest-CreateVolumesFromSnapshotTest-1996309303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:57:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a12ede10-ab5d-4ad4-9583-11593fbb3dfb tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:57:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a12ede10-ab5d-4ad4-9583-11593fbb3dfb tempest-CreateVolumesFromSnapshotTest-1996309303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:13 devstack sudo[90561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:57:13 devstack sudo[90561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:13 devstack sudo[90561]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a12ede10-ab5d-4ad4-9583-11593fbb3dfb tempest-CreateVolumesFromSnapshotTest-1996309303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.492s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:13 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-a12ede10-ab5d-4ad4-9583-11593fbb3dfb tempest-CreateVolumesFromSnapshotTest-1996309303 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:57:13 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-a12ede10-ab5d-4ad4-9583-11593fbb3dfb tempest-CreateVolumesFromSnapshotTest-1996309303 None] Deleted volume successfully. Apr 24 13:57:13 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-a12ede10-ab5d-4ad4-9583-11593fbb3dfb tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "cinder-4b7be9cf-39c7-476d-8bdc-49045a38b532-delete_volume" released by "delete_volume" :: held 1.787s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:57:14 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-463ff8b1-562e-4763-bb90-433afdcb6dcd tempest-CreateVolumesFromSnapshotTest-1996309303 None] Acquiring lock "cinder-b6094012-6584-42de-aabe-b3c6f8c39094-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:57:14 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-463ff8b1-562e-4763-bb90-433afdcb6dcd tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "cinder-b6094012-6584-42de-aabe-b3c6f8c39094-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:57:14 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-463ff8b1-562e-4763-bb90-433afdcb6dcd tempest-CreateVolumesFromSnapshotTest-1996309303 None] Acquiring lock "cinder-quobyte-b6094012-6584-42de-aabe-b3c6f8c39094" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:57:14 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-463ff8b1-562e-4763-bb90-433afdcb6dcd tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "cinder-quobyte-b6094012-6584-42de-aabe-b3c6f8c39094" acquired by "delete_volume" :: waited 0.018s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:57:14 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b81b35-199c-4195-acf6-fd84078639ea]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:57:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-463ff8b1-562e-4763-bb90-433afdcb6dcd tempest-CreateVolumesFromSnapshotTest-1996309303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b6094012-6584-42de-aabe-b3c6f8c39094 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:14 devstack sudo[90564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b6094012-6584-42de-aabe-b3c6f8c39094 Apr 24 13:57:14 devstack sudo[90564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:14 devstack sudo[90564]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-463ff8b1-562e-4763-bb90-433afdcb6dcd tempest-CreateVolumesFromSnapshotTest-1996309303 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b6094012-6584-42de-aabe-b3c6f8c39094" returned: 0 in 0.602s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-463ff8b1-562e-4763-bb90-433afdcb6dcd tempest-CreateVolumesFromSnapshotTest-1996309303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b6094012-6584-42de-aabe-b3c6f8c39094 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:14 devstack sudo[90569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b6094012-6584-42de-aabe-b3c6f8c39094 Apr 24 13:57:14 devstack sudo[90569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:15 devstack sudo[90569]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-463ff8b1-562e-4763-bb90-433afdcb6dcd tempest-CreateVolumesFromSnapshotTest-1996309303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b6094012-6584-42de-aabe-b3c6f8c39094" returned: 0 in 0.501s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:15 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-463ff8b1-562e-4763-bb90-433afdcb6dcd tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "cinder-quobyte-b6094012-6584-42de-aabe-b3c6f8c39094" released by "delete_volume" :: held 1.147s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:57:15 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-463ff8b1-562e-4763-bb90-433afdcb6dcd tempest-CreateVolumesFromSnapshotTest-1996309303 None] Created reservations ['69fd2ae5-fdfb-40bf-bf2a-03550ea0e589', '022161cd-cb9e-4044-a99b-6bc64f76c35c', 'd8a2a295-396f-4444-8f6a-d56386dd45e4', 'a13e8c30-faac-448a-b22b-915f3480141c'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:57:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-463ff8b1-562e-4763-bb90-433afdcb6dcd tempest-CreateVolumesFromSnapshotTest-1996309303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:57:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-463ff8b1-562e-4763-bb90-433afdcb6dcd tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:57:15 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-463ff8b1-562e-4763-bb90-433afdcb6dcd tempest-CreateVolumesFromSnapshotTest-1996309303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:57:15 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-463ff8b1-562e-4763-bb90-433afdcb6dcd tempest-CreateVolumesFromSnapshotTest-1996309303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:57:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-463ff8b1-562e-4763-bb90-433afdcb6dcd tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:57:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-463ff8b1-562e-4763-bb90-433afdcb6dcd tempest-CreateVolumesFromSnapshotTest-1996309303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:15 devstack sudo[90573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:57:15 devstack sudo[90573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:16 devstack sudo[90573]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:16 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-463ff8b1-562e-4763-bb90-433afdcb6dcd tempest-CreateVolumesFromSnapshotTest-1996309303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.532s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:16 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-463ff8b1-562e-4763-bb90-433afdcb6dcd tempest-CreateVolumesFromSnapshotTest-1996309303 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:57:16 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-463ff8b1-562e-4763-bb90-433afdcb6dcd tempest-CreateVolumesFromSnapshotTest-1996309303 None] Deleted volume successfully. Apr 24 13:57:16 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-463ff8b1-562e-4763-bb90-433afdcb6dcd tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "cinder-b6094012-6584-42de-aabe-b3c6f8c39094-delete_volume" released by "delete_volume" :: held 1.909s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:57:16 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d09e3a3a-3e8d-4834-a9f5-1cd44efc79ee tempest-CreateVolumesFromSnapshotTest-1996309303 None] Acquiring lock "cinder-15e1cf9d-e701-42eb-81b1-e4b9d288dbea-delete_snapshot" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:57:16 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d09e3a3a-3e8d-4834-a9f5-1cd44efc79ee tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "cinder-15e1cf9d-e701-42eb-81b1-e4b9d288dbea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:57:16 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d09e3a3a-3e8d-4834-a9f5-1cd44efc79ee tempest-CreateVolumesFromSnapshotTest-1996309303 None] Acquiring lock "cinder-quobyte-fca13286-d5e9-4835-a9aa-db392c6e0787" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:57:16 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d09e3a3a-3e8d-4834-a9f5-1cd44efc79ee tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "cinder-quobyte-fca13286-d5e9-4835-a9aa-db392c6e0787" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:57:16 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d09e3a3a-3e8d-4834-a9f5-1cd44efc79ee tempest-CreateVolumesFromSnapshotTest-1996309303 None] Acquiring lock "cinder-quobyte-15e1cf9d-e701-42eb-81b1-e4b9d288dbea" by "_delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:57:16 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d09e3a3a-3e8d-4834-a9f5-1cd44efc79ee tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "cinder-quobyte-15e1cf9d-e701-42eb-81b1-e4b9d288dbea" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:57:16 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-d09e3a3a-3e8d-4834-a9f5-1cd44efc79ee tempest-CreateVolumesFromSnapshotTest-1996309303 None] Deleting offline snapshot 15e1cf9d-e701-42eb-81b1-e4b9d288dbea of volume fca13286-d5e9-4835-a9aa-db392c6e0787 {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 13:57:16 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-d09e3a3a-3e8d-4834-a9f5-1cd44efc79ee tempest-CreateVolumesFromSnapshotTest-1996309303 None] snapshot_file for this snap is: volume-fca13286-d5e9-4835-a9aa-db392c6e0787.15e1cf9d-e701-42eb-81b1-e4b9d288dbea {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 13:57:16 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd8078a-9e94-4e39-b24e-fbdc7e26c110]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:57:16 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d09e3a3a-3e8d-4834-a9f5-1cd44efc79ee tempest-CreateVolumesFromSnapshotTest-1996309303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-fca13286-d5e9-4835-a9aa-db392c6e0787.15e1cf9d-e701-42eb-81b1-e4b9d288dbea {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:16 devstack sudo[90576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-fca13286-d5e9-4835-a9aa-db392c6e0787.15e1cf9d-e701-42eb-81b1-e4b9d288dbea Apr 24 13:57:16 devstack sudo[90576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:17 devstack sudo[90576]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d09e3a3a-3e8d-4834-a9f5-1cd44efc79ee tempest-CreateVolumesFromSnapshotTest-1996309303 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-fca13286-d5e9-4835-a9aa-db392c6e0787.15e1cf9d-e701-42eb-81b1-e4b9d288dbea" returned: 0 in 0.649s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:17 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-d09e3a3a-3e8d-4834-a9f5-1cd44efc79ee tempest-CreateVolumesFromSnapshotTest-1996309303 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fca13286-d5e9-4835-a9aa-db392c6e0787(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:57:17 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c99625-6741-49cb-a785-3b9f768a3ede]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:57:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d09e3a3a-3e8d-4834-a9f5-1cd44efc79ee tempest-CreateVolumesFromSnapshotTest-1996309303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-fca13286-d5e9-4835-a9aa-db392c6e0787 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:17 devstack sudo[90581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-fca13286-d5e9-4835-a9aa-db392c6e0787 Apr 24 13:57:17 devstack sudo[90581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:17 devstack sudo[90581]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d09e3a3a-3e8d-4834-a9f5-1cd44efc79ee tempest-CreateVolumesFromSnapshotTest-1996309303 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-fca13286-d5e9-4835-a9aa-db392c6e0787" returned: 0 in 0.605s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d09e3a3a-3e8d-4834-a9f5-1cd44efc79ee tempest-CreateVolumesFromSnapshotTest-1996309303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-fca13286-d5e9-4835-a9aa-db392c6e0787.15e1cf9d-e701-42eb-81b1-e4b9d288dbea {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:17 devstack sudo[90586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-fca13286-d5e9-4835-a9aa-db392c6e0787.15e1cf9d-e701-42eb-81b1-e4b9d288dbea Apr 24 13:57:17 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:18 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:18 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d09e3a3a-3e8d-4834-a9f5-1cd44efc79ee tempest-CreateVolumesFromSnapshotTest-1996309303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-fca13286-d5e9-4835-a9aa-db392c6e0787.15e1cf9d-e701-42eb-81b1-e4b9d288dbea" returned: 0 in 0.626s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:18 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d09e3a3a-3e8d-4834-a9f5-1cd44efc79ee tempest-CreateVolumesFromSnapshotTest-1996309303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-fca13286-d5e9-4835-a9aa-db392c6e0787.15e1cf9d-e701-42eb-81b1-e4b9d288dbea {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:18 devstack sudo[90603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-fca13286-d5e9-4835-a9aa-db392c6e0787.15e1cf9d-e701-42eb-81b1-e4b9d288dbea Apr 24 13:57:18 devstack sudo[90603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:18 devstack sudo[90603]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:18 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d09e3a3a-3e8d-4834-a9f5-1cd44efc79ee tempest-CreateVolumesFromSnapshotTest-1996309303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-fca13286-d5e9-4835-a9aa-db392c6e0787.15e1cf9d-e701-42eb-81b1-e4b9d288dbea" returned: 0 in 0.474s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:19 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d09e3a3a-3e8d-4834-a9f5-1cd44efc79ee tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "cinder-quobyte-15e1cf9d-e701-42eb-81b1-e4b9d288dbea" released by "_delete_snapshot" :: held 2.475s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:57:19 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d09e3a3a-3e8d-4834-a9f5-1cd44efc79ee tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "cinder-quobyte-fca13286-d5e9-4835-a9aa-db392c6e0787" released by "delete_snapshot" :: held 2.502s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:57:19 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-d09e3a3a-3e8d-4834-a9f5-1cd44efc79ee tempest-CreateVolumesFromSnapshotTest-1996309303 None] Created reservations ['6afd974e-f3d1-4023-a06a-907e12614cef', '727c0aee-1d24-4b0a-9431-9eb2557eeeff', 'b13485c3-599c-4090-a463-43c7e83caed2', 'b5220fcb-b740-49af-9874-f501ec0502bf'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:57:19 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-d09e3a3a-3e8d-4834-a9f5-1cd44efc79ee tempest-CreateVolumesFromSnapshotTest-1996309303 None] Delete snapshot completed successfully. Apr 24 13:57:19 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d09e3a3a-3e8d-4834-a9f5-1cd44efc79ee tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "cinder-15e1cf9d-e701-42eb-81b1-e4b9d288dbea-delete_snapshot" released by "delete_snapshot" :: held 2.650s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:57:19 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-82ed5f41-ba01-4855-ae69-daff8637f7dc tempest-CreateVolumesFromSnapshotTest-1996309303 None] Acquiring lock "cinder-fca13286-d5e9-4835-a9aa-db392c6e0787-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:57:19 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-82ed5f41-ba01-4855-ae69-daff8637f7dc tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "cinder-fca13286-d5e9-4835-a9aa-db392c6e0787-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:57:19 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-82ed5f41-ba01-4855-ae69-daff8637f7dc tempest-CreateVolumesFromSnapshotTest-1996309303 None] Acquiring lock "cinder-quobyte-fca13286-d5e9-4835-a9aa-db392c6e0787" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:57:19 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-82ed5f41-ba01-4855-ae69-daff8637f7dc tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "cinder-quobyte-fca13286-d5e9-4835-a9aa-db392c6e0787" acquired by "delete_volume" :: waited 0.018s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:57:19 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc5d9fd-71b3-484a-affc-049989d26ba6]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:57:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-82ed5f41-ba01-4855-ae69-daff8637f7dc tempest-CreateVolumesFromSnapshotTest-1996309303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-fca13286-d5e9-4835-a9aa-db392c6e0787 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:19 devstack sudo[90628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-fca13286-d5e9-4835-a9aa-db392c6e0787 Apr 24 13:57:19 devstack sudo[90628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:20 devstack sudo[90628]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-82ed5f41-ba01-4855-ae69-daff8637f7dc tempest-CreateVolumesFromSnapshotTest-1996309303 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-fca13286-d5e9-4835-a9aa-db392c6e0787" returned: 0 in 0.606s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-82ed5f41-ba01-4855-ae69-daff8637f7dc tempest-CreateVolumesFromSnapshotTest-1996309303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-fca13286-d5e9-4835-a9aa-db392c6e0787 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:20 devstack sudo[90633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-fca13286-d5e9-4835-a9aa-db392c6e0787 Apr 24 13:57:20 devstack sudo[90633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:20 devstack sudo[90633]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-82ed5f41-ba01-4855-ae69-daff8637f7dc tempest-CreateVolumesFromSnapshotTest-1996309303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-fca13286-d5e9-4835-a9aa-db392c6e0787" returned: 0 in 0.557s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:20 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-82ed5f41-ba01-4855-ae69-daff8637f7dc tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "cinder-quobyte-fca13286-d5e9-4835-a9aa-db392c6e0787" released by "delete_volume" :: held 1.238s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:57:21 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-82ed5f41-ba01-4855-ae69-daff8637f7dc tempest-CreateVolumesFromSnapshotTest-1996309303 None] Created reservations ['f1e82254-0174-434e-b6dc-d717b476261f', '80c74e9e-cd82-482a-aced-d2275e97610a', '491248db-5407-4b4e-8b81-5fbb1156bd8d', '1a911d3c-ad4d-43ae-b168-2e6a503d36ab'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:57:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-82ed5f41-ba01-4855-ae69-daff8637f7dc tempest-CreateVolumesFromSnapshotTest-1996309303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:57:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-82ed5f41-ba01-4855-ae69-daff8637f7dc tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:57:21 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-82ed5f41-ba01-4855-ae69-daff8637f7dc tempest-CreateVolumesFromSnapshotTest-1996309303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:57:21 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-82ed5f41-ba01-4855-ae69-daff8637f7dc tempest-CreateVolumesFromSnapshotTest-1996309303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:57:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-82ed5f41-ba01-4855-ae69-daff8637f7dc tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:57:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-82ed5f41-ba01-4855-ae69-daff8637f7dc tempest-CreateVolumesFromSnapshotTest-1996309303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:21 devstack sudo[90636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:57:21 devstack sudo[90636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:21 devstack sudo[90636]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-82ed5f41-ba01-4855-ae69-daff8637f7dc tempest-CreateVolumesFromSnapshotTest-1996309303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.486s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:21 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-82ed5f41-ba01-4855-ae69-daff8637f7dc tempest-CreateVolumesFromSnapshotTest-1996309303 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:57:21 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-82ed5f41-ba01-4855-ae69-daff8637f7dc tempest-CreateVolumesFromSnapshotTest-1996309303 None] Deleted volume successfully. Apr 24 13:57:21 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-82ed5f41-ba01-4855-ae69-daff8637f7dc tempest-CreateVolumesFromSnapshotTest-1996309303 None] Lock "cinder-fca13286-d5e9-4835-a9aa-db392c6e0787-delete_volume" released by "delete_volume" :: held 1.972s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:57:24 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-708cb85a-adb9-413a-bb83-ab662c7da16a tempest-VolumeDependencyTests-1757944956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:57:24 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-708cb85a-adb9-413a-bb83-ab662c7da16a tempest-VolumeDependencyTests-1757944956 None] Flow 'volume_create_manager' (b8e493dc-2f3e-4380-a122-ac1800cbdb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:57:24 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-708cb85a-adb9-413a-bb83-ab662c7da16a tempest-VolumeDependencyTests-1757944956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4cc9cc9-f568-45da-a373-c96d7d671c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:57:24 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-708cb85a-adb9-413a-bb83-ab662c7da16a tempest-VolumeDependencyTests-1757944956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4cc9cc9-f568-45da-a373-c96d7d671c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2051274100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9684fe87-cfaa-42fd-b2e3-dd450bad8846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00b5e95a44724d5fb36b824fefc699ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:57:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:57:25Z,use_quota=True,user_id='b39ede14869e47fe84e376a0f40f77e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:57:24 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-708cb85a-adb9-413a-bb83-ab662c7da16a tempest-VolumeDependencyTests-1757944956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75159300-ab45-4ac1-933e-801c4870d489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:57:24 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-708cb85a-adb9-413a-bb83-ab662c7da16a tempest-VolumeDependencyTests-1757944956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75159300-ab45-4ac1-933e-801c4870d489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:57:24 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-708cb85a-adb9-413a-bb83-ab662c7da16a tempest-VolumeDependencyTests-1757944956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd884c43-7b10-490c-8712-8c46b337740a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:57:24 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-708cb85a-adb9-413a-bb83-ab662c7da16a tempest-VolumeDependencyTests-1757944956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd884c43-7b10-490c-8712-8c46b337740a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9684fe87-cfaa-42fd-b2e3-dd450bad8846', 'volume_name': 'volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:57:24 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-708cb85a-adb9-413a-bb83-ab662c7da16a tempest-VolumeDependencyTests-1757944956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bf0065a-1025-4317-b0f4-4326712e6cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:57:24 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-708cb85a-adb9-413a-bb83-ab662c7da16a tempest-VolumeDependencyTests-1757944956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bf0065a-1025-4317-b0f4-4326712e6cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:57:24 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-708cb85a-adb9-413a-bb83-ab662c7da16a tempest-VolumeDependencyTests-1757944956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f307b5f-f021-4ea8-9f6e-3f02955fff6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:57:24 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-708cb85a-adb9-413a-bb83-ab662c7da16a tempest-VolumeDependencyTests-1757944956 None] Volume 9684fe87-cfaa-42fd-b2e3-dd450bad8846: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846', 'volume_size': 1} Apr 24 13:57:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-708cb85a-adb9-413a-bb83-ab662c7da16a tempest-VolumeDependencyTests-1757944956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:57:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-708cb85a-adb9-413a-bb83-ab662c7da16a tempest-VolumeDependencyTests-1757944956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:57:24 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-708cb85a-adb9-413a-bb83-ab662c7da16a tempest-VolumeDependencyTests-1757944956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2051274100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9684fe87-cfaa-42fd-b2e3-dd450bad8846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00b5e95a44724d5fb36b824fefc699ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:57:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:57:25Z,use_quota=True,user_id='b39ede14869e47fe84e376a0f40f77e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:57:24 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-708cb85a-adb9-413a-bb83-ab662c7da16a tempest-VolumeDependencyTests-1757944956 None] Creating volume 9684fe87-cfaa-42fd-b2e3-dd450bad8846 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:57:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-708cb85a-adb9-413a-bb83-ab662c7da16a tempest-VolumeDependencyTests-1757944956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:57:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-708cb85a-adb9-413a-bb83-ab662c7da16a tempest-VolumeDependencyTests-1757944956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:57:24 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-708cb85a-adb9-413a-bb83-ab662c7da16a tempest-VolumeDependencyTests-1757944956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:57:24 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-708cb85a-adb9-413a-bb83-ab662c7da16a tempest-VolumeDependencyTests-1757944956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:57:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-708cb85a-adb9-413a-bb83-ab662c7da16a tempest-VolumeDependencyTests-1757944956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:57:24 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-708cb85a-adb9-413a-bb83-ab662c7da16a tempest-VolumeDependencyTests-1757944956 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:57:24 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-708cb85a-adb9-413a-bb83-ab662c7da16a tempest-VolumeDependencyTests-1757944956 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:57:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-708cb85a-adb9-413a-bb83-ab662c7da16a tempest-VolumeDependencyTests-1757944956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:24 devstack sudo[90639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846 1073741824 Apr 24 13:57:24 devstack sudo[90639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:25 devstack sudo[90639]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:25 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-708cb85a-adb9-413a-bb83-ab662c7da16a tempest-VolumeDependencyTests-1757944956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846 1073741824" returned: 0 in 0.634s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:25 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-708cb85a-adb9-413a-bb83-ab662c7da16a tempest-VolumeDependencyTests-1757944956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:25 devstack sudo[90644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846 Apr 24 13:57:25 devstack sudo[90644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:25 devstack sudo[90644]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:25 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-708cb85a-adb9-413a-bb83-ab662c7da16a tempest-VolumeDependencyTests-1757944956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846" returned: 0 in 0.502s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:25 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-708cb85a-adb9-413a-bb83-ab662c7da16a tempest-VolumeDependencyTests-1757944956 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:57:25 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-708cb85a-adb9-413a-bb83-ab662c7da16a tempest-VolumeDependencyTests-1757944956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:57:26 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-708cb85a-adb9-413a-bb83-ab662c7da16a tempest-VolumeDependencyTests-1757944956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f307b5f-f021-4ea8-9f6e-3f02955fff6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:57:26 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-708cb85a-adb9-413a-bb83-ab662c7da16a tempest-VolumeDependencyTests-1757944956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bec89db2-f6e6-46d8-9faa-1ea4c7756b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:57:26 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-708cb85a-adb9-413a-bb83-ab662c7da16a tempest-VolumeDependencyTests-1757944956 None] Volume volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846 (9684fe87-cfaa-42fd-b2e3-dd450bad8846): created successfully Apr 24 13:57:26 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-708cb85a-adb9-413a-bb83-ab662c7da16a tempest-VolumeDependencyTests-1757944956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bec89db2-f6e6-46d8-9faa-1ea4c7756b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:57:26 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-708cb85a-adb9-413a-bb83-ab662c7da16a tempest-VolumeDependencyTests-1757944956 None] Flow 'volume_create_manager' (b8e493dc-2f3e-4380-a122-ac1800cbdb81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:57:26 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-708cb85a-adb9-413a-bb83-ab662c7da16a tempest-VolumeDependencyTests-1757944956 None] Created volume successfully. Apr 24 13:57:27 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-7c7381a9-3187-4f97-b119-9c32e097c08c tempest-VolumeDependencyTests-1757944956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:57:27 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-7c7381a9-3187-4f97-b119-9c32e097c08c tempest-VolumeDependencyTests-1757944956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:57:27 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-7c7381a9-3187-4f97-b119-9c32e097c08c tempest-VolumeDependencyTests-1757944956 None] Creating offline snapshot a0a96f7b-3456-4c3e-9ae2-911311cf3eb6 of volume 9684fe87-cfaa-42fd-b2e3-dd450bad8846 {{(pid=82046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 13:57:27 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[e006550d-382f-490a-bb3f-4ba3b9008dfa]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:57:27 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7c7381a9-3187-4f97-b119-9c32e097c08c tempest-VolumeDependencyTests-1757944956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:27 devstack sudo[90648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846 Apr 24 13:57:27 devstack sudo[90648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:27 devstack sudo[90648]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:27 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7c7381a9-3187-4f97-b119-9c32e097c08c tempest-VolumeDependencyTests-1757944956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846" returned: 0 in 0.595s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:27 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7c7381a9-3187-4f97-b119-9c32e097c08c tempest-VolumeDependencyTests-1757944956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846.a0a96f7b-3456-4c3e-9ae2-911311cf3eb6 1G {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:27 devstack sudo[90653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846.a0a96f7b-3456-4c3e-9ae2-911311cf3eb6 1G Apr 24 13:57:27 devstack sudo[90653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:28 devstack sudo[90653]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7c7381a9-3187-4f97-b119-9c32e097c08c tempest-VolumeDependencyTests-1757944956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846.a0a96f7b-3456-4c3e-9ae2-911311cf3eb6 1G" returned: 0 in 0.697s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7c7381a9-3187-4f97-b119-9c32e097c08c tempest-VolumeDependencyTests-1757944956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846.a0a96f7b-3456-4c3e-9ae2-911311cf3eb6 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:28 devstack sudo[90658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846.a0a96f7b-3456-4c3e-9ae2-911311cf3eb6 Apr 24 13:57:28 devstack sudo[90658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:28 devstack sudo[90658]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7c7381a9-3187-4f97-b119-9c32e097c08c tempest-VolumeDependencyTests-1757944956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846.a0a96f7b-3456-4c3e-9ae2-911311cf3eb6" returned: 0 in 0.521s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:28 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-7c7381a9-3187-4f97-b119-9c32e097c08c tempest-VolumeDependencyTests-1757944956 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846.a0a96f7b-3456-4c3e-9ae2-911311cf3eb6 is being set with open permissions: ugo+rw Apr 24 13:57:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7c7381a9-3187-4f97-b119-9c32e097c08c tempest-VolumeDependencyTests-1757944956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846.a0a96f7b-3456-4c3e-9ae2-911311cf3eb6 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:28 devstack sudo[90663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846.a0a96f7b-3456-4c3e-9ae2-911311cf3eb6 Apr 24 13:57:28 devstack sudo[90663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:29 devstack sudo[90663]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7c7381a9-3187-4f97-b119-9c32e097c08c tempest-VolumeDependencyTests-1757944956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846.a0a96f7b-3456-4c3e-9ae2-911311cf3eb6" returned: 0 in 0.507s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7c7381a9-3187-4f97-b119-9c32e097c08c tempest-VolumeDependencyTests-1757944956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:29 devstack sudo[90666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846.info Apr 24 13:57:29 devstack sudo[90666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:29 devstack sudo[90666]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7c7381a9-3187-4f97-b119-9c32e097c08c tempest-VolumeDependencyTests-1757944956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846.info" returned: 0 in 0.512s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:29 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-7c7381a9-3187-4f97-b119-9c32e097c08c tempest-VolumeDependencyTests-1757944956 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846.info is being set with open permissions: ugo+rw Apr 24 13:57:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7c7381a9-3187-4f97-b119-9c32e097c08c tempest-VolumeDependencyTests-1757944956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:30 devstack sudo[90669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846.info Apr 24 13:57:30 devstack sudo[90669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:30 devstack sudo[90669]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-7c7381a9-3187-4f97-b119-9c32e097c08c tempest-VolumeDependencyTests-1757944956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846.info" returned: 0 in 0.504s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-7c7381a9-3187-4f97-b119-9c32e097c08c tempest-VolumeDependencyTests-1757944956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.431s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:57:30 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-7c7381a9-3187-4f97-b119-9c32e097c08c tempest-VolumeDependencyTests-1757944956 None] Create snapshot completed successfully Apr 24 13:57:31 devstack cinder-volume[82046]: DEBUG dbcounter [-] [82046] Writing DB stats cinder:SELECT=81,cinder:INSERT=32,cinder:UPDATE=125,cinder:DELETE=12 {{(pid=82046) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 13:57:31 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:57:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] Flow 'volume_create_manager' (4ce5ea2b-83fa-466b-b0ee-8b58348945f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:57:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c2d7109-79af-4a49-ab3b-524b661e95a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:57:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c2d7109-79af-4a49-ab3b-524b661e95a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-287096008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca595f86-99c7-4cf9-9935-35329f4b8571,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00b5e95a44724d5fb36b824fefc699ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a0a96f7b-3456-4c3e-9ae2-911311cf3eb6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:57:32Z,use_quota=True,user_id='b39ede14869e47fe84e376a0f40f77e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:57:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b50da92b-b117-459a-bb36-3412f80108c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:57:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b50da92b-b117-459a-bb36-3412f80108c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:57:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd11c724-e8b6-49bb-a766-e820143d0990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:57:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd11c724-e8b6-49bb-a766-e820143d0990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ca595f86-99c7-4cf9-9935-35329f4b8571', 'volume_name': 'volume-ca595f86-99c7-4cf9-9935-35329f4b8571', 'volume_size': 1, 'snapshot_id': 'a0a96f7b-3456-4c3e-9ae2-911311cf3eb6'}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:57:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7647d10-c1bb-4b06-8063-d7932d88abd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:57:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7647d10-c1bb-4b06-8063-d7932d88abd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:57:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e76d57a-1c07-4643-8d16-c4b40b8708e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:57:31 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] Volume ca595f86-99c7-4cf9-9935-35329f4b8571: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ca595f86-99c7-4cf9-9935-35329f4b8571', 'volume_size': 1, 'snapshot_id': 'a0a96f7b-3456-4c3e-9ae2-911311cf3eb6'} Apr 24 13:57:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:57:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:57:31 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] Acquiring lock "cinder-quobyte-a0a96f7b-3456-4c3e-9ae2-911311cf3eb6-ca595f86-99c7-4cf9-9935-35329f4b8571" by "_create_volume_from_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:57:31 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] Lock "cinder-quobyte-a0a96f7b-3456-4c3e-9ae2-911311cf3eb6-ca595f86-99c7-4cf9-9935-35329f4b8571" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:57:31 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] Creating volume ca595f86-99c7-4cf9-9935-35329f4b8571 from snapshot a0a96f7b-3456-4c3e-9ae2-911311cf3eb6 {{(pid=82046) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 13:57:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:57:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:57:31 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:57:31 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:57:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:57:31 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:57:31 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] Acquiring lock "cinder-quobyte-ca595f86-99c7-4cf9-9935-35329f4b8571" by "_copy_volume_from_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:57:31 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] Lock "cinder-quobyte-ca595f86-99c7-4cf9-9935-35329f4b8571" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:57:31 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] snapshot: a0a96f7b-3456-4c3e-9ae2-911311cf3eb6, volume: ca595f86-99c7-4cf9-9935-35329f4b8571, {{(pid=82046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 13:57:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:57:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:57:31 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:57:31 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:57:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:57:31 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d70d28-3bfa-46b5-bf27-78359744c7a5]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:57:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846.a0a96f7b-3456-4c3e-9ae2-911311cf3eb6 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:31 devstack sudo[90672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846.a0a96f7b-3456-4c3e-9ae2-911311cf3eb6 Apr 24 13:57:31 devstack sudo[90672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:32 devstack sudo[90672]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846.a0a96f7b-3456-4c3e-9ae2-911311cf3eb6" returned: 0 in 0.535s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:32 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:57:32 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846 {{(pid=82046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 13:57:32 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] Creating direct copy from snapshot {{(pid=82046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 13:57:32 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ace5ebf-7a86-43d0-833e-be0c9997815d]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:57:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:32 devstack sudo[90677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846 Apr 24 13:57:32 devstack sudo[90677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:32 devstack sudo[90677]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846" returned: 0 in 0.546s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:33 devstack cinder-volume[82046]: DEBUG cinder.utils [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] Path /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-ca595f86-99c7-4cf9-9935-35329f4b8571 not found in is_blk_device check {{(pid=82046) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 13:57:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-ca595f86-99c7-4cf9-9935-35329f4b8571 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:33 devstack sudo[90682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-ca595f86-99c7-4cf9-9935-35329f4b8571 Apr 24 13:57:33 devstack sudo[90682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:37 devstack cinder-volume[82046]: DEBUG oslo_service.periodic_task [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82046) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 13:57:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:57:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:57:37 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:57:37 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:57:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:57:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:37 devstack sudo[90697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:57:37 devstack sudo[90697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:37 devstack sudo[90682]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-ca595f86-99c7-4cf9-9935-35329f4b8571" returned: 0 in 4.985s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:38 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[345be261-3fe4-4d1a-8e02-21bc00a6fc59]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:57:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:38 devstack sudo[90699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846 Apr 24 13:57:38 devstack sudo[90699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:38 devstack sudo[90697]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.473s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:38 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:57:38 devstack sudo[90699]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846" returned: 0 in 0.705s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:38 devstack cinder-volume[82046]: DEBUG cinder.image.image_utils [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] Image conversion details: src /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846, size 1024.00 MB, duration 4.99 sec, destination /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-ca595f86-99c7-4cf9-9935-35329f4b8571 {{(pid=82046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 13:57:38 devstack cinder-volume[82046]: INFO cinder.image.image_utils [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] Converted 1024.00 MB image at 205.38 MB/s Apr 24 13:57:38 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-ca595f86-99c7-4cf9-9935-35329f4b8571 is being set with open permissions: ugo+rw Apr 24 13:57:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-ca595f86-99c7-4cf9-9935-35329f4b8571 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:38 devstack sudo[90705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-ca595f86-99c7-4cf9-9935-35329f4b8571 Apr 24 13:57:38 devstack sudo[90705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:39 devstack sudo[90705]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-ca595f86-99c7-4cf9-9935-35329f4b8571" returned: 0 in 0.467s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:39 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] Lock "cinder-quobyte-ca595f86-99c7-4cf9-9935-35329f4b8571" released by "_copy_volume_from_snapshot" :: held 7.346s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:57:39 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] Lock "cinder-quobyte-a0a96f7b-3456-4c3e-9ae2-911311cf3eb6-ca595f86-99c7-4cf9-9935-35329f4b8571" released by "_create_volume_from_snapshot" :: held 7.381s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:57:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.397s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:57:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e76d57a-1c07-4643-8d16-c4b40b8708e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca595f86-99c7-4cf9-9935-35329f4b8571', 'volume_size': 1, 'snapshot_id': 'a0a96f7b-3456-4c3e-9ae2-911311cf3eb6'}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:57:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bf0a9af-c4d2-40e7-96f0-64bea1b519f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:57:39 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] Volume volume-ca595f86-99c7-4cf9-9935-35329f4b8571 (ca595f86-99c7-4cf9-9935-35329f4b8571): created successfully Apr 24 13:57:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bf0a9af-c4d2-40e7-96f0-64bea1b519f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:57:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] Flow 'volume_create_manager' (4ce5ea2b-83fa-466b-b0ee-8b58348945f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:57:39 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-0cf3945b-4fd4-44a1-8d63-a1fb0afd942e tempest-VolumeDependencyTests-1757944956 None] Created volume successfully. Apr 24 13:57:39 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-93860545-326e-458b-961b-b60fefd9334f tempest-VolumeDependencyTests-1757944956 None] Acquiring lock "cinder-a0a96f7b-3456-4c3e-9ae2-911311cf3eb6-delete_snapshot" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:57:39 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-93860545-326e-458b-961b-b60fefd9334f tempest-VolumeDependencyTests-1757944956 None] Lock "cinder-a0a96f7b-3456-4c3e-9ae2-911311cf3eb6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:57:39 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-93860545-326e-458b-961b-b60fefd9334f tempest-VolumeDependencyTests-1757944956 None] Acquiring lock "cinder-quobyte-9684fe87-cfaa-42fd-b2e3-dd450bad8846" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:57:39 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-93860545-326e-458b-961b-b60fefd9334f tempest-VolumeDependencyTests-1757944956 None] Lock "cinder-quobyte-9684fe87-cfaa-42fd-b2e3-dd450bad8846" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:57:39 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-93860545-326e-458b-961b-b60fefd9334f tempest-VolumeDependencyTests-1757944956 None] Acquiring lock "cinder-quobyte-a0a96f7b-3456-4c3e-9ae2-911311cf3eb6" by "_delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:57:39 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-93860545-326e-458b-961b-b60fefd9334f tempest-VolumeDependencyTests-1757944956 None] Lock "cinder-quobyte-a0a96f7b-3456-4c3e-9ae2-911311cf3eb6" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:57:39 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-93860545-326e-458b-961b-b60fefd9334f tempest-VolumeDependencyTests-1757944956 None] Deleting offline snapshot a0a96f7b-3456-4c3e-9ae2-911311cf3eb6 of volume 9684fe87-cfaa-42fd-b2e3-dd450bad8846 {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 13:57:39 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-93860545-326e-458b-961b-b60fefd9334f tempest-VolumeDependencyTests-1757944956 None] snapshot_file for this snap is: volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846.a0a96f7b-3456-4c3e-9ae2-911311cf3eb6 {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 13:57:39 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d8fbbc-88e4-49f7-8ccf-a2f87a799d0d]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:57:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-93860545-326e-458b-961b-b60fefd9334f tempest-VolumeDependencyTests-1757944956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846.a0a96f7b-3456-4c3e-9ae2-911311cf3eb6 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:39 devstack sudo[90708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846.a0a96f7b-3456-4c3e-9ae2-911311cf3eb6 Apr 24 13:57:39 devstack sudo[90708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:40 devstack sudo[90708]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:40 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-93860545-326e-458b-961b-b60fefd9334f tempest-VolumeDependencyTests-1757944956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846.a0a96f7b-3456-4c3e-9ae2-911311cf3eb6" returned: 0 in 0.573s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:40 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-93860545-326e-458b-961b-b60fefd9334f tempest-VolumeDependencyTests-1757944956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:57:40 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[145c647e-cfc4-4af0-8ecc-529dd02bb12b]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:57:40 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-93860545-326e-458b-961b-b60fefd9334f tempest-VolumeDependencyTests-1757944956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:40 devstack sudo[90713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846 Apr 24 13:57:40 devstack sudo[90713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:40 devstack sudo[90713]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:40 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-93860545-326e-458b-961b-b60fefd9334f tempest-VolumeDependencyTests-1757944956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846" returned: 0 in 0.573s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:40 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-93860545-326e-458b-961b-b60fefd9334f tempest-VolumeDependencyTests-1757944956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846.a0a96f7b-3456-4c3e-9ae2-911311cf3eb6 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:40 devstack sudo[90718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846.a0a96f7b-3456-4c3e-9ae2-911311cf3eb6 Apr 24 13:57:40 devstack sudo[90718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:41 devstack sudo[90718]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-93860545-326e-458b-961b-b60fefd9334f tempest-VolumeDependencyTests-1757944956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846.a0a96f7b-3456-4c3e-9ae2-911311cf3eb6" returned: 0 in 0.595s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-93860545-326e-458b-961b-b60fefd9334f tempest-VolumeDependencyTests-1757944956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846.a0a96f7b-3456-4c3e-9ae2-911311cf3eb6 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:41 devstack sudo[90723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846.a0a96f7b-3456-4c3e-9ae2-911311cf3eb6 Apr 24 13:57:41 devstack sudo[90723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:41 devstack sudo[90723]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-93860545-326e-458b-961b-b60fefd9334f tempest-VolumeDependencyTests-1757944956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846.a0a96f7b-3456-4c3e-9ae2-911311cf3eb6" returned: 0 in 0.476s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:41 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-93860545-326e-458b-961b-b60fefd9334f tempest-VolumeDependencyTests-1757944956 None] Lock "cinder-quobyte-a0a96f7b-3456-4c3e-9ae2-911311cf3eb6" released by "_delete_snapshot" :: held 2.320s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:57:41 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-93860545-326e-458b-961b-b60fefd9334f tempest-VolumeDependencyTests-1757944956 None] Lock "cinder-quobyte-9684fe87-cfaa-42fd-b2e3-dd450bad8846" released by "delete_snapshot" :: held 2.351s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:57:41 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-93860545-326e-458b-961b-b60fefd9334f tempest-VolumeDependencyTests-1757944956 None] Created reservations ['3c036df5-1c77-4c0e-a227-0fc87b302c97', '448120da-117f-4997-9b05-5fafa9520780', '388ba7ec-e05f-4d3d-8777-8d5ec5a7156b', 'f69da871-5dde-41ee-8c7c-140271ba3929'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:57:41 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-93860545-326e-458b-961b-b60fefd9334f tempest-VolumeDependencyTests-1757944956 None] Delete snapshot completed successfully. Apr 24 13:57:41 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-93860545-326e-458b-961b-b60fefd9334f tempest-VolumeDependencyTests-1757944956 None] Lock "cinder-a0a96f7b-3456-4c3e-9ae2-911311cf3eb6-delete_snapshot" released by "delete_snapshot" :: held 2.528s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:57:42 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-341c857c-0cb2-4902-bb4e-42ee4c982c60 tempest-VolumeDependencyTests-1757944956 None] Acquiring lock "cinder-9684fe87-cfaa-42fd-b2e3-dd450bad8846-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:57:42 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-341c857c-0cb2-4902-bb4e-42ee4c982c60 tempest-VolumeDependencyTests-1757944956 None] Lock "cinder-9684fe87-cfaa-42fd-b2e3-dd450bad8846-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:57:42 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-341c857c-0cb2-4902-bb4e-42ee4c982c60 tempest-VolumeDependencyTests-1757944956 None] Acquiring lock "cinder-quobyte-9684fe87-cfaa-42fd-b2e3-dd450bad8846" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:57:42 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-341c857c-0cb2-4902-bb4e-42ee4c982c60 tempest-VolumeDependencyTests-1757944956 None] Lock "cinder-quobyte-9684fe87-cfaa-42fd-b2e3-dd450bad8846" acquired by "delete_volume" :: waited 0.016s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:57:42 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e81b7c-2c07-48dc-adb8-0fad675e1f54]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:57:42 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-341c857c-0cb2-4902-bb4e-42ee4c982c60 tempest-VolumeDependencyTests-1757944956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:42 devstack sudo[90727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846 Apr 24 13:57:42 devstack sudo[90727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:43 devstack sudo[90727]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-341c857c-0cb2-4902-bb4e-42ee4c982c60 tempest-VolumeDependencyTests-1757944956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846" returned: 0 in 0.658s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-341c857c-0cb2-4902-bb4e-42ee4c982c60 tempest-VolumeDependencyTests-1757944956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:43 devstack sudo[90732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846 Apr 24 13:57:43 devstack sudo[90732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:43 devstack sudo[90732]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-341c857c-0cb2-4902-bb4e-42ee4c982c60 tempest-VolumeDependencyTests-1757944956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9684fe87-cfaa-42fd-b2e3-dd450bad8846" returned: 0 in 0.512s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:43 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-341c857c-0cb2-4902-bb4e-42ee4c982c60 tempest-VolumeDependencyTests-1757944956 None] Lock "cinder-quobyte-9684fe87-cfaa-42fd-b2e3-dd450bad8846" released by "delete_volume" :: held 1.242s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:57:44 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-341c857c-0cb2-4902-bb4e-42ee4c982c60 tempest-VolumeDependencyTests-1757944956 None] Created reservations ['c2039708-6fec-4417-bf60-a6d09eddbc8c', '07b4ba2e-acb4-4c93-a6a6-3c82c9864a4f', 'd829c2c5-5ab8-4a45-bb12-e73b70a6eda8', 'b8d35785-6c53-4adc-8755-9bc5e4165a95'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:57:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-341c857c-0cb2-4902-bb4e-42ee4c982c60 tempest-VolumeDependencyTests-1757944956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:57:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-341c857c-0cb2-4902-bb4e-42ee4c982c60 tempest-VolumeDependencyTests-1757944956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:57:44 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-341c857c-0cb2-4902-bb4e-42ee4c982c60 tempest-VolumeDependencyTests-1757944956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:57:44 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-341c857c-0cb2-4902-bb4e-42ee4c982c60 tempest-VolumeDependencyTests-1757944956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:57:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-341c857c-0cb2-4902-bb4e-42ee4c982c60 tempest-VolumeDependencyTests-1757944956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:57:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-341c857c-0cb2-4902-bb4e-42ee4c982c60 tempest-VolumeDependencyTests-1757944956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:44 devstack sudo[90735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:57:44 devstack sudo[90735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:44 devstack sudo[90735]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-341c857c-0cb2-4902-bb4e-42ee4c982c60 tempest-VolumeDependencyTests-1757944956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.512s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:44 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-341c857c-0cb2-4902-bb4e-42ee4c982c60 tempest-VolumeDependencyTests-1757944956 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:57:44 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-341c857c-0cb2-4902-bb4e-42ee4c982c60 tempest-VolumeDependencyTests-1757944956 None] Deleted volume successfully. Apr 24 13:57:44 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-341c857c-0cb2-4902-bb4e-42ee4c982c60 tempest-VolumeDependencyTests-1757944956 None] Lock "cinder-9684fe87-cfaa-42fd-b2e3-dd450bad8846-delete_volume" released by "delete_volume" :: held 2.072s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:57:45 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-a660ab4b-999c-4d9e-9719-15f8d5e3658c tempest-VolumeDependencyTests-1757944956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:57:45 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a660ab4b-999c-4d9e-9719-15f8d5e3658c tempest-VolumeDependencyTests-1757944956 None] Flow 'volume_create_manager' (3d10a0fc-7079-4566-9c38-fac25f3db218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:57:45 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a660ab4b-999c-4d9e-9719-15f8d5e3658c tempest-VolumeDependencyTests-1757944956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3af1212e-c501-4179-ac33-4f3a8f8d7343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:57:45 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a660ab4b-999c-4d9e-9719-15f8d5e3658c tempest-VolumeDependencyTests-1757944956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3af1212e-c501-4179-ac33-4f3a8f8d7343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1635698678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0cdbb27-5999-486e-955b-3eb812ff7a54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00b5e95a44724d5fb36b824fefc699ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:57:45Z,use_quota=True,user_id='b39ede14869e47fe84e376a0f40f77e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:57:45 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a660ab4b-999c-4d9e-9719-15f8d5e3658c tempest-VolumeDependencyTests-1757944956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ee48e5a-c0af-4133-8cad-38fd6b95625b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:57:45 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a660ab4b-999c-4d9e-9719-15f8d5e3658c tempest-VolumeDependencyTests-1757944956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ee48e5a-c0af-4133-8cad-38fd6b95625b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:57:45 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a660ab4b-999c-4d9e-9719-15f8d5e3658c tempest-VolumeDependencyTests-1757944956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b3f65cd-ccfe-4009-9ecd-cc969787660b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:57:45 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a660ab4b-999c-4d9e-9719-15f8d5e3658c tempest-VolumeDependencyTests-1757944956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b3f65cd-ccfe-4009-9ecd-cc969787660b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0cdbb27-5999-486e-955b-3eb812ff7a54', 'volume_name': 'volume-b0cdbb27-5999-486e-955b-3eb812ff7a54', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:57:45 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a660ab4b-999c-4d9e-9719-15f8d5e3658c tempest-VolumeDependencyTests-1757944956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a609e364-5c41-4374-b596-823a6d61c320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:57:45 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a660ab4b-999c-4d9e-9719-15f8d5e3658c tempest-VolumeDependencyTests-1757944956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a609e364-5c41-4374-b596-823a6d61c320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:57:45 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a660ab4b-999c-4d9e-9719-15f8d5e3658c tempest-VolumeDependencyTests-1757944956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93ea82ec-152d-4c55-980c-b739931eb503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:57:45 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-a660ab4b-999c-4d9e-9719-15f8d5e3658c tempest-VolumeDependencyTests-1757944956 None] Volume b0cdbb27-5999-486e-955b-3eb812ff7a54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0cdbb27-5999-486e-955b-3eb812ff7a54', 'volume_size': 1} Apr 24 13:57:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a660ab4b-999c-4d9e-9719-15f8d5e3658c tempest-VolumeDependencyTests-1757944956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:57:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a660ab4b-999c-4d9e-9719-15f8d5e3658c tempest-VolumeDependencyTests-1757944956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:57:45 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a660ab4b-999c-4d9e-9719-15f8d5e3658c tempest-VolumeDependencyTests-1757944956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1635698678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0cdbb27-5999-486e-955b-3eb812ff7a54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00b5e95a44724d5fb36b824fefc699ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:57:45Z,use_quota=True,user_id='b39ede14869e47fe84e376a0f40f77e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:57:45 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-a660ab4b-999c-4d9e-9719-15f8d5e3658c tempest-VolumeDependencyTests-1757944956 None] Creating volume b0cdbb27-5999-486e-955b-3eb812ff7a54 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:57:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a660ab4b-999c-4d9e-9719-15f8d5e3658c tempest-VolumeDependencyTests-1757944956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:57:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a660ab4b-999c-4d9e-9719-15f8d5e3658c tempest-VolumeDependencyTests-1757944956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:57:45 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a660ab4b-999c-4d9e-9719-15f8d5e3658c tempest-VolumeDependencyTests-1757944956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:57:45 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a660ab4b-999c-4d9e-9719-15f8d5e3658c tempest-VolumeDependencyTests-1757944956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:57:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a660ab4b-999c-4d9e-9719-15f8d5e3658c tempest-VolumeDependencyTests-1757944956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:57:45 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a660ab4b-999c-4d9e-9719-15f8d5e3658c tempest-VolumeDependencyTests-1757944956 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:57:45 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-a660ab4b-999c-4d9e-9719-15f8d5e3658c tempest-VolumeDependencyTests-1757944956 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:57:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a660ab4b-999c-4d9e-9719-15f8d5e3658c tempest-VolumeDependencyTests-1757944956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:45 devstack sudo[90738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54 1073741824 Apr 24 13:57:45 devstack sudo[90738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:45 devstack sudo[90738]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a660ab4b-999c-4d9e-9719-15f8d5e3658c tempest-VolumeDependencyTests-1757944956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54 1073741824" returned: 0 in 0.623s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a660ab4b-999c-4d9e-9719-15f8d5e3658c tempest-VolumeDependencyTests-1757944956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:46 devstack sudo[90744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54 Apr 24 13:57:46 devstack sudo[90744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:46 devstack sudo[90744]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:46 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a660ab4b-999c-4d9e-9719-15f8d5e3658c tempest-VolumeDependencyTests-1757944956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54" returned: 0 in 0.473s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:46 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a660ab4b-999c-4d9e-9719-15f8d5e3658c tempest-VolumeDependencyTests-1757944956 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:57:46 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a660ab4b-999c-4d9e-9719-15f8d5e3658c tempest-VolumeDependencyTests-1757944956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:57:46 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a660ab4b-999c-4d9e-9719-15f8d5e3658c tempest-VolumeDependencyTests-1757944956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93ea82ec-152d-4c55-980c-b739931eb503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0cdbb27-5999-486e-955b-3eb812ff7a54', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:57:46 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a660ab4b-999c-4d9e-9719-15f8d5e3658c tempest-VolumeDependencyTests-1757944956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (114f720a-cd57-4f12-b81a-e08ea33b065c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:57:46 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-a660ab4b-999c-4d9e-9719-15f8d5e3658c tempest-VolumeDependencyTests-1757944956 None] Volume volume-b0cdbb27-5999-486e-955b-3eb812ff7a54 (b0cdbb27-5999-486e-955b-3eb812ff7a54): created successfully Apr 24 13:57:46 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a660ab4b-999c-4d9e-9719-15f8d5e3658c tempest-VolumeDependencyTests-1757944956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (114f720a-cd57-4f12-b81a-e08ea33b065c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:57:46 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a660ab4b-999c-4d9e-9719-15f8d5e3658c tempest-VolumeDependencyTests-1757944956 None] Flow 'volume_create_manager' (3d10a0fc-7079-4566-9c38-fac25f3db218) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:57:46 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-a660ab4b-999c-4d9e-9719-15f8d5e3658c tempest-VolumeDependencyTests-1757944956 None] Created volume successfully. Apr 24 13:57:47 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:57:47 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Flow 'volume_create_manager' (fca32099-abf0-41d2-91d4-5b389e5992f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:57:47 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89a5fff7-48dc-4c7f-8571-5c6227d8419e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:57:47 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89a5fff7-48dc-4c7f-8571-5c6227d8419e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1554246329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86bb2c8a-5571-44df-90fd-d75aa981356f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00b5e95a44724d5fb36b824fefc699ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=b0cdbb27-5999-486e-955b-3eb812ff7a54,status='creating',terminated_at=None,updated_at=2026-04-24T11:57:48Z,use_quota=True,user_id='b39ede14869e47fe84e376a0f40f77e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:57:47 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e648be6-7a02-41ee-b9cb-2b7a0f4174d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:57:47 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e648be6-7a02-41ee-b9cb-2b7a0f4174d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:57:47 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5031ff6b-40f4-4cf7-8776-e675cc92ea45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:57:47 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5031ff6b-40f4-4cf7-8776-e675cc92ea45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '86bb2c8a-5571-44df-90fd-d75aa981356f', 'volume_name': 'volume-86bb2c8a-5571-44df-90fd-d75aa981356f', 'volume_size': 1, 'source_volid': 'b0cdbb27-5999-486e-955b-3eb812ff7a54', 'source_volstatus': 'available'}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:57:47 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (757bb7b2-428e-45a9-979a-307cd59bf549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:57:47 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (757bb7b2-428e-45a9-979a-307cd59bf549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:57:47 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55c4c689-38f6-4a41-8d26-a2bd7f2c707b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:57:47 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Volume 86bb2c8a-5571-44df-90fd-d75aa981356f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-86bb2c8a-5571-44df-90fd-d75aa981356f', 'volume_size': 1, 'source_volid': 'b0cdbb27-5999-486e-955b-3eb812ff7a54', 'source_volstatus': 'available'} Apr 24 13:57:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:57:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:57:47 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Cloning volume b0cdbb27-5999-486e-955b-3eb812ff7a54 to volume 86bb2c8a-5571-44df-90fd-d75aa981356f Apr 24 13:57:47 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Creating offline snapshot 755c3d02-45af-488d-9b9c-a1b702085cd4 of volume b0cdbb27-5999-486e-955b-3eb812ff7a54 {{(pid=82046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 13:57:47 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a71d9b-f57a-4bfa-a7c3-294f7f31e6df]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:57:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:48 devstack sudo[90747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54 Apr 24 13:57:48 devstack sudo[90747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:48 devstack sudo[90747]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54" returned: 0 in 0.626s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54.755c3d02-45af-488d-9b9c-a1b702085cd4 1G {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:48 devstack sudo[90752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54.755c3d02-45af-488d-9b9c-a1b702085cd4 1G Apr 24 13:57:48 devstack sudo[90752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:49 devstack sudo[90752]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54.755c3d02-45af-488d-9b9c-a1b702085cd4 1G" returned: 0 in 0.674s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0cdbb27-5999-486e-955b-3eb812ff7a54 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54.755c3d02-45af-488d-9b9c-a1b702085cd4 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:49 devstack sudo[90757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0cdbb27-5999-486e-955b-3eb812ff7a54 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54.755c3d02-45af-488d-9b9c-a1b702085cd4 Apr 24 13:57:49 devstack sudo[90757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:49 devstack sudo[90757]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0cdbb27-5999-486e-955b-3eb812ff7a54 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54.755c3d02-45af-488d-9b9c-a1b702085cd4" returned: 0 in 0.548s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:49 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54.755c3d02-45af-488d-9b9c-a1b702085cd4 is being set with open permissions: ugo+rw Apr 24 13:57:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54.755c3d02-45af-488d-9b9c-a1b702085cd4 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:49 devstack sudo[90768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54.755c3d02-45af-488d-9b9c-a1b702085cd4 Apr 24 13:57:49 devstack sudo[90768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:50 devstack sudo[90768]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54.755c3d02-45af-488d-9b9c-a1b702085cd4" returned: 0 in 0.494s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:50 devstack sudo[90771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54.info Apr 24 13:57:50 devstack sudo[90771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:50 devstack sudo[90771]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54.info" returned: 0 in 0.501s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:50 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54.info is being set with open permissions: ugo+rw Apr 24 13:57:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:50 devstack sudo[90774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54.info Apr 24 13:57:50 devstack sudo[90774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:51 devstack sudo[90774]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54.info" returned: 0 in 0.526s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:51 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Acquiring lock "cinder-quobyte-86bb2c8a-5571-44df-90fd-d75aa981356f" by "_copy_volume_from_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:57:51 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Lock "cinder-quobyte-86bb2c8a-5571-44df-90fd-d75aa981356f" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:57:51 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] snapshot: 755c3d02-45af-488d-9b9c-a1b702085cd4, volume: 86bb2c8a-5571-44df-90fd-d75aa981356f, {{(pid=82046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 13:57:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:57:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:57:51 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:57:51 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:57:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:57:51 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[59be34ca-ea4a-4ca0-9eb0-4f4bed3b98fe]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:57:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54.755c3d02-45af-488d-9b9c-a1b702085cd4 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:51 devstack sudo[90777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54.755c3d02-45af-488d-9b9c-a1b702085cd4 Apr 24 13:57:51 devstack sudo[90777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:52 devstack sudo[90777]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:52 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54.755c3d02-45af-488d-9b9c-a1b702085cd4" returned: 0 in 0.598s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:52 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0cdbb27-5999-486e-955b-3eb812ff7a54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:57:52 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54 {{(pid=82046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 13:57:52 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Creating direct copy from snapshot {{(pid=82046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 13:57:52 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[54380634-92f7-4c30-aede-3e720aed67f2]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:57:52 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:52 devstack sudo[90782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54 Apr 24 13:57:52 devstack sudo[90782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:52 devstack sudo[90782]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:52 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54" returned: 0 in 0.610s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:52 devstack cinder-volume[82046]: DEBUG cinder.utils [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Path /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-86bb2c8a-5571-44df-90fd-d75aa981356f not found in is_blk_device check {{(pid=82046) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 13:57:52 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-86bb2c8a-5571-44df-90fd-d75aa981356f {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:52 devstack sudo[90787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-86bb2c8a-5571-44df-90fd-d75aa981356f Apr 24 13:57:52 devstack sudo[90787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:57 devstack sudo[90787]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:57 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-86bb2c8a-5571-44df-90fd-d75aa981356f" returned: 0 in 4.982s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:57 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c599ffe-61ca-43eb-a519-7ddce2cf162c]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:57:57 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:57 devstack sudo[90800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54 Apr 24 13:57:57 devstack sudo[90800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:58 devstack sudo[90800]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54" returned: 0 in 0.664s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:58 devstack cinder-volume[82046]: DEBUG cinder.image.image_utils [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Image conversion details: src /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54, size 1024.00 MB, duration 4.98 sec, destination /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-86bb2c8a-5571-44df-90fd-d75aa981356f {{(pid=82046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 13:57:58 devstack cinder-volume[82046]: INFO cinder.image.image_utils [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Converted 1024.00 MB image at 205.44 MB/s Apr 24 13:57:58 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-86bb2c8a-5571-44df-90fd-d75aa981356f is being set with open permissions: ugo+rw Apr 24 13:57:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-86bb2c8a-5571-44df-90fd-d75aa981356f {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:58 devstack sudo[90805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-86bb2c8a-5571-44df-90fd-d75aa981356f Apr 24 13:57:58 devstack sudo[90805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:58 devstack sudo[90805]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-86bb2c8a-5571-44df-90fd-d75aa981356f" returned: 0 in 0.492s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:58 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Lock "cinder-quobyte-86bb2c8a-5571-44df-90fd-d75aa981356f" released by "_copy_volume_from_snapshot" :: held 7.437s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:57:58 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Acquiring lock "cinder-quobyte-755c3d02-45af-488d-9b9c-a1b702085cd4" by "_delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:57:58 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Lock "cinder-quobyte-755c3d02-45af-488d-9b9c-a1b702085cd4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:57:58 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Deleting offline snapshot 755c3d02-45af-488d-9b9c-a1b702085cd4 of volume b0cdbb27-5999-486e-955b-3eb812ff7a54 {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 13:57:58 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] snapshot_file for this snap is: volume-b0cdbb27-5999-486e-955b-3eb812ff7a54.755c3d02-45af-488d-9b9c-a1b702085cd4 {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 13:57:58 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5374ef6-abde-472e-9d7d-9580f5119da6]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:57:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54.755c3d02-45af-488d-9b9c-a1b702085cd4 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:58 devstack sudo[90808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54.755c3d02-45af-488d-9b9c-a1b702085cd4 Apr 24 13:57:58 devstack sudo[90808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:57:59 devstack sudo[90808]: pam_unix(sudo:session): session closed for user root Apr 24 13:57:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54.755c3d02-45af-488d-9b9c-a1b702085cd4" returned: 0 in 0.606s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:57:59 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0cdbb27-5999-486e-955b-3eb812ff7a54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:57:59 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[32924e56-e3e5-47f0-82ea-764c53d846d6]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:57:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:57:59 devstack sudo[90813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54 Apr 24 13:57:59 devstack sudo[90813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:00 devstack sudo[90813]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:00 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54" returned: 0 in 0.669s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:00 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54.755c3d02-45af-488d-9b9c-a1b702085cd4 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:00 devstack sudo[90818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54.755c3d02-45af-488d-9b9c-a1b702085cd4 Apr 24 13:58:00 devstack sudo[90818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:00 devstack cinder-volume[82046]: DEBUG dbcounter [-] [82046] Writing DB stats cinder:SELECT=19,cinder:UPDATE=15,cinder:DELETE=2,cinder:INSERT=6 {{(pid=82046) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 13:58:00 devstack sudo[90818]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:00 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54.755c3d02-45af-488d-9b9c-a1b702085cd4" returned: 0 in 0.646s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:00 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54.755c3d02-45af-488d-9b9c-a1b702085cd4 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:00 devstack sudo[90823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54.755c3d02-45af-488d-9b9c-a1b702085cd4 Apr 24 13:58:00 devstack sudo[90823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:01 devstack sudo[90823]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54.755c3d02-45af-488d-9b9c-a1b702085cd4" returned: 0 in 0.539s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:01 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Lock "cinder-quobyte-755c3d02-45af-488d-9b9c-a1b702085cd4" released by "_delete_snapshot" :: held 2.568s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:58:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.615s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:58:01 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55c4c689-38f6-4a41-8d26-a2bd7f2c707b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86bb2c8a-5571-44df-90fd-d75aa981356f', 'volume_size': 1, 'source_volid': 'b0cdbb27-5999-486e-955b-3eb812ff7a54', 'source_volstatus': 'available'}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:01 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (840ab70b-fb0a-4939-9dee-1cac3b2670ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:01 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Volume volume-86bb2c8a-5571-44df-90fd-d75aa981356f (86bb2c8a-5571-44df-90fd-d75aa981356f): created successfully Apr 24 13:58:01 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (840ab70b-fb0a-4939-9dee-1cac3b2670ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:01 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Flow 'volume_create_manager' (fca32099-abf0-41d2-91d4-5b389e5992f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:58:01 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-5ae2dbf2-4ac9-4660-89d6-879da91710b8 tempest-VolumeDependencyTests-1757944956 None] Created volume successfully. Apr 24 13:58:01 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b2073444-b495-4903-80ea-2c897674ec69 tempest-VolumeDependencyTests-1757944956 None] Acquiring lock "cinder-b0cdbb27-5999-486e-955b-3eb812ff7a54-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:58:01 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b2073444-b495-4903-80ea-2c897674ec69 tempest-VolumeDependencyTests-1757944956 None] Lock "cinder-b0cdbb27-5999-486e-955b-3eb812ff7a54-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:58:01 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b2073444-b495-4903-80ea-2c897674ec69 tempest-VolumeDependencyTests-1757944956 None] Acquiring lock "cinder-quobyte-b0cdbb27-5999-486e-955b-3eb812ff7a54" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:58:01 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b2073444-b495-4903-80ea-2c897674ec69 tempest-VolumeDependencyTests-1757944956 None] Lock "cinder-quobyte-b0cdbb27-5999-486e-955b-3eb812ff7a54" acquired by "delete_volume" :: waited 0.020s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:58:01 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c23b91-1a7d-484a-91de-a42a41d95f11]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:58:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b2073444-b495-4903-80ea-2c897674ec69 tempest-VolumeDependencyTests-1757944956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:02 devstack sudo[90826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54 Apr 24 13:58:02 devstack sudo[90826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:02 devstack sudo[90826]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b2073444-b495-4903-80ea-2c897674ec69 tempest-VolumeDependencyTests-1757944956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54" returned: 0 in 0.633s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b2073444-b495-4903-80ea-2c897674ec69 tempest-VolumeDependencyTests-1757944956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:02 devstack sudo[90831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54 Apr 24 13:58:02 devstack sudo[90831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:03 devstack sudo[90831]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b2073444-b495-4903-80ea-2c897674ec69 tempest-VolumeDependencyTests-1757944956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b0cdbb27-5999-486e-955b-3eb812ff7a54" returned: 0 in 0.529s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:03 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b2073444-b495-4903-80ea-2c897674ec69 tempest-VolumeDependencyTests-1757944956 None] Lock "cinder-quobyte-b0cdbb27-5999-486e-955b-3eb812ff7a54" released by "delete_volume" :: held 1.229s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:58:03 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-b2073444-b495-4903-80ea-2c897674ec69 tempest-VolumeDependencyTests-1757944956 None] Created reservations ['9cacff6b-69e8-4a7d-9c7b-497e2a4238c2', '6ec264d7-1444-44af-b78a-51f71069073f', '0c06468f-7b03-48a1-82b1-835a27fc3bbd', '69b5e7b5-1788-496f-849c-31c34b3c3bae'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:58:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b2073444-b495-4903-80ea-2c897674ec69 tempest-VolumeDependencyTests-1757944956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:58:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b2073444-b495-4903-80ea-2c897674ec69 tempest-VolumeDependencyTests-1757944956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:58:03 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b2073444-b495-4903-80ea-2c897674ec69 tempest-VolumeDependencyTests-1757944956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:58:03 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b2073444-b495-4903-80ea-2c897674ec69 tempest-VolumeDependencyTests-1757944956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:58:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b2073444-b495-4903-80ea-2c897674ec69 tempest-VolumeDependencyTests-1757944956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:58:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b2073444-b495-4903-80ea-2c897674ec69 tempest-VolumeDependencyTests-1757944956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:03 devstack sudo[90834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:58:03 devstack sudo[90834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:03 devstack sudo[90834]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b2073444-b495-4903-80ea-2c897674ec69 tempest-VolumeDependencyTests-1757944956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.554s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:03 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-b2073444-b495-4903-80ea-2c897674ec69 tempest-VolumeDependencyTests-1757944956 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:58:03 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-b2073444-b495-4903-80ea-2c897674ec69 tempest-VolumeDependencyTests-1757944956 None] Deleted volume successfully. Apr 24 13:58:03 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b2073444-b495-4903-80ea-2c897674ec69 tempest-VolumeDependencyTests-1757944956 None] Lock "cinder-b0cdbb27-5999-486e-955b-3eb812ff7a54-delete_volume" released by "delete_volume" :: held 2.032s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:58:04 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-bfdbfaae-9f92-4b6c-b1b7-facb84bc16c1 tempest-VolumeDependencyTests-1757944956 None] Acquiring lock "cinder-86bb2c8a-5571-44df-90fd-d75aa981356f-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:58:04 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-bfdbfaae-9f92-4b6c-b1b7-facb84bc16c1 tempest-VolumeDependencyTests-1757944956 None] Lock "cinder-86bb2c8a-5571-44df-90fd-d75aa981356f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:58:04 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-bfdbfaae-9f92-4b6c-b1b7-facb84bc16c1 tempest-VolumeDependencyTests-1757944956 None] Acquiring lock "cinder-quobyte-86bb2c8a-5571-44df-90fd-d75aa981356f" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:58:04 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-bfdbfaae-9f92-4b6c-b1b7-facb84bc16c1 tempest-VolumeDependencyTests-1757944956 None] Lock "cinder-quobyte-86bb2c8a-5571-44df-90fd-d75aa981356f" acquired by "delete_volume" :: waited 0.023s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:58:04 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[473d78a9-21be-4f65-ba69-29d821aeb6d1]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:58:04 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bfdbfaae-9f92-4b6c-b1b7-facb84bc16c1 tempest-VolumeDependencyTests-1757944956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-86bb2c8a-5571-44df-90fd-d75aa981356f {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:04 devstack sudo[90837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-86bb2c8a-5571-44df-90fd-d75aa981356f Apr 24 13:58:04 devstack sudo[90837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:04 devstack sudo[90837]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:04 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bfdbfaae-9f92-4b6c-b1b7-facb84bc16c1 tempest-VolumeDependencyTests-1757944956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-86bb2c8a-5571-44df-90fd-d75aa981356f" returned: 0 in 0.594s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:04 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bfdbfaae-9f92-4b6c-b1b7-facb84bc16c1 tempest-VolumeDependencyTests-1757944956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-86bb2c8a-5571-44df-90fd-d75aa981356f {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:04 devstack sudo[90842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-86bb2c8a-5571-44df-90fd-d75aa981356f Apr 24 13:58:04 devstack sudo[90842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:05 devstack sudo[90842]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:05 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bfdbfaae-9f92-4b6c-b1b7-facb84bc16c1 tempest-VolumeDependencyTests-1757944956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-86bb2c8a-5571-44df-90fd-d75aa981356f" returned: 0 in 0.503s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:05 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-bfdbfaae-9f92-4b6c-b1b7-facb84bc16c1 tempest-VolumeDependencyTests-1757944956 None] Lock "cinder-quobyte-86bb2c8a-5571-44df-90fd-d75aa981356f" released by "delete_volume" :: held 1.141s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:58:05 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-bfdbfaae-9f92-4b6c-b1b7-facb84bc16c1 tempest-VolumeDependencyTests-1757944956 None] Created reservations ['6e9f2732-faaf-4ef6-9e57-b8d1bd223ea8', '704ce65e-8db9-487e-9153-0cf1318d565b', '386aa91b-84d9-47cc-8e45-7bbf3d833b3e', '3864dddc-fe80-4613-a94b-fbb8b51f95b5'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:58:05 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-bfdbfaae-9f92-4b6c-b1b7-facb84bc16c1 tempest-VolumeDependencyTests-1757944956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:58:05 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-bfdbfaae-9f92-4b6c-b1b7-facb84bc16c1 tempest-VolumeDependencyTests-1757944956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:58:05 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-bfdbfaae-9f92-4b6c-b1b7-facb84bc16c1 tempest-VolumeDependencyTests-1757944956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:58:05 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-bfdbfaae-9f92-4b6c-b1b7-facb84bc16c1 tempest-VolumeDependencyTests-1757944956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:58:05 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-bfdbfaae-9f92-4b6c-b1b7-facb84bc16c1 tempest-VolumeDependencyTests-1757944956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:58:05 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bfdbfaae-9f92-4b6c-b1b7-facb84bc16c1 tempest-VolumeDependencyTests-1757944956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:05 devstack sudo[90845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:58:05 devstack sudo[90845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:06 devstack sudo[90845]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bfdbfaae-9f92-4b6c-b1b7-facb84bc16c1 tempest-VolumeDependencyTests-1757944956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.491s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:06 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-bfdbfaae-9f92-4b6c-b1b7-facb84bc16c1 tempest-VolumeDependencyTests-1757944956 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:58:06 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-bfdbfaae-9f92-4b6c-b1b7-facb84bc16c1 tempest-VolumeDependencyTests-1757944956 None] Deleted volume successfully. Apr 24 13:58:06 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-bfdbfaae-9f92-4b6c-b1b7-facb84bc16c1 tempest-VolumeDependencyTests-1757944956 None] Lock "cinder-86bb2c8a-5571-44df-90fd-d75aa981356f-delete_volume" released by "delete_volume" :: held 1.873s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:58:06 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-de5713a4-6bcf-402c-be77-c3f4dcebde21 tempest-VolumeDependencyTests-1757944956 None] Acquiring lock "cinder-ca595f86-99c7-4cf9-9935-35329f4b8571-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:58:06 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-de5713a4-6bcf-402c-be77-c3f4dcebde21 tempest-VolumeDependencyTests-1757944956 None] Lock "cinder-ca595f86-99c7-4cf9-9935-35329f4b8571-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:58:06 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-de5713a4-6bcf-402c-be77-c3f4dcebde21 tempest-VolumeDependencyTests-1757944956 None] Acquiring lock "cinder-quobyte-ca595f86-99c7-4cf9-9935-35329f4b8571" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:58:06 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-de5713a4-6bcf-402c-be77-c3f4dcebde21 tempest-VolumeDependencyTests-1757944956 None] Lock "cinder-quobyte-ca595f86-99c7-4cf9-9935-35329f4b8571" acquired by "delete_volume" :: waited 0.016s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:58:06 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1aad8e3-1ab6-4d34-9b89-70d11d461e24]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:58:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-de5713a4-6bcf-402c-be77-c3f4dcebde21 tempest-VolumeDependencyTests-1757944956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-ca595f86-99c7-4cf9-9935-35329f4b8571 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:06 devstack sudo[90849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-ca595f86-99c7-4cf9-9935-35329f4b8571 Apr 24 13:58:06 devstack sudo[90849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:07 devstack sudo[90849]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-de5713a4-6bcf-402c-be77-c3f4dcebde21 tempest-VolumeDependencyTests-1757944956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-ca595f86-99c7-4cf9-9935-35329f4b8571" returned: 0 in 0.567s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-de5713a4-6bcf-402c-be77-c3f4dcebde21 tempest-VolumeDependencyTests-1757944956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-ca595f86-99c7-4cf9-9935-35329f4b8571 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:07 devstack sudo[90854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-ca595f86-99c7-4cf9-9935-35329f4b8571 Apr 24 13:58:07 devstack sudo[90854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:07 devstack sudo[90854]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-de5713a4-6bcf-402c-be77-c3f4dcebde21 tempest-VolumeDependencyTests-1757944956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-ca595f86-99c7-4cf9-9935-35329f4b8571" returned: 0 in 0.502s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:07 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-de5713a4-6bcf-402c-be77-c3f4dcebde21 tempest-VolumeDependencyTests-1757944956 None] Lock "cinder-quobyte-ca595f86-99c7-4cf9-9935-35329f4b8571" released by "delete_volume" :: held 1.116s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:58:07 devstack cinder-volume[82046]: DEBUG dbcounter [-] [82046] Writing DB stats cinder:SELECT=69,cinder:INSERT=22,cinder:UPDATE=100,cinder:DELETE=4 {{(pid=82046) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 13:58:07 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-de5713a4-6bcf-402c-be77-c3f4dcebde21 tempest-VolumeDependencyTests-1757944956 None] Created reservations ['60904e59-3152-43c1-8a83-f10edcfe4dcf', '36e039e2-89b9-4c21-abe0-398e32737a7c', '2d66c240-fa25-49eb-a6af-45c215855473', '03fb97ff-7704-4a14-8969-add11494001a'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:58:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de5713a4-6bcf-402c-be77-c3f4dcebde21 tempest-VolumeDependencyTests-1757944956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:58:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de5713a4-6bcf-402c-be77-c3f4dcebde21 tempest-VolumeDependencyTests-1757944956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:58:07 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-de5713a4-6bcf-402c-be77-c3f4dcebde21 tempest-VolumeDependencyTests-1757944956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:58:07 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-de5713a4-6bcf-402c-be77-c3f4dcebde21 tempest-VolumeDependencyTests-1757944956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:58:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de5713a4-6bcf-402c-be77-c3f4dcebde21 tempest-VolumeDependencyTests-1757944956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:58:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-de5713a4-6bcf-402c-be77-c3f4dcebde21 tempest-VolumeDependencyTests-1757944956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:07 devstack sudo[90857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:58:07 devstack sudo[90857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:08 devstack sudo[90857]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-de5713a4-6bcf-402c-be77-c3f4dcebde21 tempest-VolumeDependencyTests-1757944956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.493s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:08 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-de5713a4-6bcf-402c-be77-c3f4dcebde21 tempest-VolumeDependencyTests-1757944956 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:58:08 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-de5713a4-6bcf-402c-be77-c3f4dcebde21 tempest-VolumeDependencyTests-1757944956 None] Deleted volume successfully. Apr 24 13:58:08 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-de5713a4-6bcf-402c-be77-c3f4dcebde21 tempest-VolumeDependencyTests-1757944956 None] Lock "cinder-ca595f86-99c7-4cf9-9935-35329f4b8571-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:58:11 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-adb19dbb-7c49-4bfd-aec1-60891c817d4e tempest-CinderUnicodeTest-1430473231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:58:11 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-adb19dbb-7c49-4bfd-aec1-60891c817d4e tempest-CinderUnicodeTest-1430473231 None] Flow 'volume_create_manager' (399b581c-ce79-419f-bdbe-51404e9829b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:58:11 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-adb19dbb-7c49-4bfd-aec1-60891c817d4e tempest-CinderUnicodeTest-1430473231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f06b3e87-47f3-4df6-b2ad-427ff6473353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:11 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-adb19dbb-7c49-4bfd-aec1-60891c817d4e tempest-CinderUnicodeTest-1430473231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f06b3e87-47f3-4df6-b2ad-427ff6473353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:58:11Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e44d8a2-679e-4aef-a2cf-eeb57bc125e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e0f959c426a4e18b1ceac304f8754ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:58:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:58:12Z,use_quota=True,user_id='67c51be9b5bf490ab2c8378c25dc7fa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:11 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-adb19dbb-7c49-4bfd-aec1-60891c817d4e tempest-CinderUnicodeTest-1430473231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7553c40e-152a-4991-83ae-754f169b47c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:11 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-adb19dbb-7c49-4bfd-aec1-60891c817d4e tempest-CinderUnicodeTest-1430473231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7553c40e-152a-4991-83ae-754f169b47c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:11 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-adb19dbb-7c49-4bfd-aec1-60891c817d4e tempest-CinderUnicodeTest-1430473231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (973f1ae6-b15e-4b9d-8472-dda45f7d4367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:11 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-adb19dbb-7c49-4bfd-aec1-60891c817d4e tempest-CinderUnicodeTest-1430473231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (973f1ae6-b15e-4b9d-8472-dda45f7d4367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e44d8a2-679e-4aef-a2cf-eeb57bc125e4', 'volume_name': 'volume-4e44d8a2-679e-4aef-a2cf-eeb57bc125e4', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:11 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-adb19dbb-7c49-4bfd-aec1-60891c817d4e tempest-CinderUnicodeTest-1430473231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46542cb1-ab5f-4aca-87c3-3e2e6f34f6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:11 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-adb19dbb-7c49-4bfd-aec1-60891c817d4e tempest-CinderUnicodeTest-1430473231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46542cb1-ab5f-4aca-87c3-3e2e6f34f6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:11 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-adb19dbb-7c49-4bfd-aec1-60891c817d4e tempest-CinderUnicodeTest-1430473231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bda9f218-3e5f-42dd-8b04-f65947642da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:11 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-adb19dbb-7c49-4bfd-aec1-60891c817d4e tempest-CinderUnicodeTest-1430473231 None] Volume 4e44d8a2-679e-4aef-a2cf-eeb57bc125e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e44d8a2-679e-4aef-a2cf-eeb57bc125e4', 'volume_size': 1} Apr 24 13:58:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-adb19dbb-7c49-4bfd-aec1-60891c817d4e tempest-CinderUnicodeTest-1430473231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:58:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-adb19dbb-7c49-4bfd-aec1-60891c817d4e tempest-CinderUnicodeTest-1430473231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:58:11 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-adb19dbb-7c49-4bfd-aec1-60891c817d4e tempest-CinderUnicodeTest-1430473231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:58:11Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e44d8a2-679e-4aef-a2cf-eeb57bc125e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e0f959c426a4e18b1ceac304f8754ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:58:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:58:12Z,use_quota=True,user_id='67c51be9b5bf490ab2c8378c25dc7fa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:58:11 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-adb19dbb-7c49-4bfd-aec1-60891c817d4e tempest-CinderUnicodeTest-1430473231 None] Creating volume 4e44d8a2-679e-4aef-a2cf-eeb57bc125e4 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:58:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-adb19dbb-7c49-4bfd-aec1-60891c817d4e tempest-CinderUnicodeTest-1430473231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:58:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-adb19dbb-7c49-4bfd-aec1-60891c817d4e tempest-CinderUnicodeTest-1430473231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:58:11 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-adb19dbb-7c49-4bfd-aec1-60891c817d4e tempest-CinderUnicodeTest-1430473231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:58:11 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-adb19dbb-7c49-4bfd-aec1-60891c817d4e tempest-CinderUnicodeTest-1430473231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:58:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-adb19dbb-7c49-4bfd-aec1-60891c817d4e tempest-CinderUnicodeTest-1430473231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:58:11 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-adb19dbb-7c49-4bfd-aec1-60891c817d4e tempest-CinderUnicodeTest-1430473231 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:58:11 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-adb19dbb-7c49-4bfd-aec1-60891c817d4e tempest-CinderUnicodeTest-1430473231 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:58:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-adb19dbb-7c49-4bfd-aec1-60891c817d4e tempest-CinderUnicodeTest-1430473231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4e44d8a2-679e-4aef-a2cf-eeb57bc125e4 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:11 devstack sudo[90861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4e44d8a2-679e-4aef-a2cf-eeb57bc125e4 1073741824 Apr 24 13:58:11 devstack sudo[90861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:12 devstack sudo[90861]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-adb19dbb-7c49-4bfd-aec1-60891c817d4e tempest-CinderUnicodeTest-1430473231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4e44d8a2-679e-4aef-a2cf-eeb57bc125e4 1073741824" returned: 0 in 0.641s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-adb19dbb-7c49-4bfd-aec1-60891c817d4e tempest-CinderUnicodeTest-1430473231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4e44d8a2-679e-4aef-a2cf-eeb57bc125e4 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:12 devstack sudo[90866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4e44d8a2-679e-4aef-a2cf-eeb57bc125e4 Apr 24 13:58:12 devstack sudo[90866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:12 devstack sudo[90866]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-adb19dbb-7c49-4bfd-aec1-60891c817d4e tempest-CinderUnicodeTest-1430473231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4e44d8a2-679e-4aef-a2cf-eeb57bc125e4" returned: 0 in 0.468s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:12 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-adb19dbb-7c49-4bfd-aec1-60891c817d4e tempest-CinderUnicodeTest-1430473231 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:58:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-adb19dbb-7c49-4bfd-aec1-60891c817d4e tempest-CinderUnicodeTest-1430473231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:58:12 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-adb19dbb-7c49-4bfd-aec1-60891c817d4e tempest-CinderUnicodeTest-1430473231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bda9f218-3e5f-42dd-8b04-f65947642da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e44d8a2-679e-4aef-a2cf-eeb57bc125e4', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:12 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-adb19dbb-7c49-4bfd-aec1-60891c817d4e tempest-CinderUnicodeTest-1430473231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1d0e06e-1e1b-47a1-bbe7-2353b2819693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:12 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-adb19dbb-7c49-4bfd-aec1-60891c817d4e tempest-CinderUnicodeTest-1430473231 None] Volume volume-4e44d8a2-679e-4aef-a2cf-eeb57bc125e4 (4e44d8a2-679e-4aef-a2cf-eeb57bc125e4): created successfully Apr 24 13:58:12 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-adb19dbb-7c49-4bfd-aec1-60891c817d4e tempest-CinderUnicodeTest-1430473231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1d0e06e-1e1b-47a1-bbe7-2353b2819693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:12 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-adb19dbb-7c49-4bfd-aec1-60891c817d4e tempest-CinderUnicodeTest-1430473231 None] Flow 'volume_create_manager' (399b581c-ce79-419f-bdbe-51404e9829b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:58:12 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-adb19dbb-7c49-4bfd-aec1-60891c817d4e tempest-CinderUnicodeTest-1430473231 None] Created volume successfully. Apr 24 13:58:14 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-de711d4b-1676-4e21-a8e0-a7b092d1ab15 tempest-CinderUnicodeTest-1430473231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:58:14 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-de711d4b-1676-4e21-a8e0-a7b092d1ab15 tempest-CinderUnicodeTest-1430473231 None] Flow 'volume_create_manager' (31520488-4db3-4573-8fda-cab6165dd65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:58:14 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-de711d4b-1676-4e21-a8e0-a7b092d1ab15 tempest-CinderUnicodeTest-1430473231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ff95770-9194-44a4-8157-15c813f82704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:14 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-de711d4b-1676-4e21-a8e0-a7b092d1ab15 tempest-CinderUnicodeTest-1430473231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ff95770-9194-44a4-8157-15c813f82704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:58:14Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-322831770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7418c88-5f23-40de-ae45-39759b2b2720,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e0f959c426a4e18b1ceac304f8754ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:58:14Z,use_quota=True,user_id='67c51be9b5bf490ab2c8378c25dc7fa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:14 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-de711d4b-1676-4e21-a8e0-a7b092d1ab15 tempest-CinderUnicodeTest-1430473231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a3e49fb-859c-4abb-a350-95a3c380c3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:14 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-de711d4b-1676-4e21-a8e0-a7b092d1ab15 tempest-CinderUnicodeTest-1430473231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a3e49fb-859c-4abb-a350-95a3c380c3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:14 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-de711d4b-1676-4e21-a8e0-a7b092d1ab15 tempest-CinderUnicodeTest-1430473231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebf79854-525d-4f8f-858b-6b911ae3c053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:14 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-de711d4b-1676-4e21-a8e0-a7b092d1ab15 tempest-CinderUnicodeTest-1430473231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebf79854-525d-4f8f-858b-6b911ae3c053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7418c88-5f23-40de-ae45-39759b2b2720', 'volume_name': 'volume-c7418c88-5f23-40de-ae45-39759b2b2720', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:14 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-de711d4b-1676-4e21-a8e0-a7b092d1ab15 tempest-CinderUnicodeTest-1430473231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2b3a04a-f7f9-47bc-b0b1-badc928f9627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:14 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-de711d4b-1676-4e21-a8e0-a7b092d1ab15 tempest-CinderUnicodeTest-1430473231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2b3a04a-f7f9-47bc-b0b1-badc928f9627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:14 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-de711d4b-1676-4e21-a8e0-a7b092d1ab15 tempest-CinderUnicodeTest-1430473231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f327fdff-c0a0-4c9b-9ea8-2d0c281e986a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:14 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-de711d4b-1676-4e21-a8e0-a7b092d1ab15 tempest-CinderUnicodeTest-1430473231 None] Volume c7418c88-5f23-40de-ae45-39759b2b2720: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7418c88-5f23-40de-ae45-39759b2b2720', 'volume_size': 1} Apr 24 13:58:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de711d4b-1676-4e21-a8e0-a7b092d1ab15 tempest-CinderUnicodeTest-1430473231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:58:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de711d4b-1676-4e21-a8e0-a7b092d1ab15 tempest-CinderUnicodeTest-1430473231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:58:14 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-de711d4b-1676-4e21-a8e0-a7b092d1ab15 tempest-CinderUnicodeTest-1430473231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:58:14Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-322831770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7418c88-5f23-40de-ae45-39759b2b2720,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e0f959c426a4e18b1ceac304f8754ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:58:14Z,use_quota=True,user_id='67c51be9b5bf490ab2c8378c25dc7fa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:58:14 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-de711d4b-1676-4e21-a8e0-a7b092d1ab15 tempest-CinderUnicodeTest-1430473231 None] Creating volume c7418c88-5f23-40de-ae45-39759b2b2720 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:58:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de711d4b-1676-4e21-a8e0-a7b092d1ab15 tempest-CinderUnicodeTest-1430473231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:58:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de711d4b-1676-4e21-a8e0-a7b092d1ab15 tempest-CinderUnicodeTest-1430473231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:58:14 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-de711d4b-1676-4e21-a8e0-a7b092d1ab15 tempest-CinderUnicodeTest-1430473231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:58:14 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-de711d4b-1676-4e21-a8e0-a7b092d1ab15 tempest-CinderUnicodeTest-1430473231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:58:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de711d4b-1676-4e21-a8e0-a7b092d1ab15 tempest-CinderUnicodeTest-1430473231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:58:14 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-de711d4b-1676-4e21-a8e0-a7b092d1ab15 tempest-CinderUnicodeTest-1430473231 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:58:14 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-de711d4b-1676-4e21-a8e0-a7b092d1ab15 tempest-CinderUnicodeTest-1430473231 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:58:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-de711d4b-1676-4e21-a8e0-a7b092d1ab15 tempest-CinderUnicodeTest-1430473231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c7418c88-5f23-40de-ae45-39759b2b2720 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:14 devstack sudo[90869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c7418c88-5f23-40de-ae45-39759b2b2720 1073741824 Apr 24 13:58:14 devstack sudo[90869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:14 devstack sudo[90869]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-de711d4b-1676-4e21-a8e0-a7b092d1ab15 tempest-CinderUnicodeTest-1430473231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c7418c88-5f23-40de-ae45-39759b2b2720 1073741824" returned: 0 in 0.699s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-de711d4b-1676-4e21-a8e0-a7b092d1ab15 tempest-CinderUnicodeTest-1430473231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c7418c88-5f23-40de-ae45-39759b2b2720 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:15 devstack sudo[90874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c7418c88-5f23-40de-ae45-39759b2b2720 Apr 24 13:58:15 devstack sudo[90874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:15 devstack sudo[90874]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-de711d4b-1676-4e21-a8e0-a7b092d1ab15 tempest-CinderUnicodeTest-1430473231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c7418c88-5f23-40de-ae45-39759b2b2720" returned: 0 in 0.523s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:15 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-de711d4b-1676-4e21-a8e0-a7b092d1ab15 tempest-CinderUnicodeTest-1430473231 None] <== create_volume: return (1264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:58:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de711d4b-1676-4e21-a8e0-a7b092d1ab15 tempest-CinderUnicodeTest-1430473231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.267s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:58:15 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-de711d4b-1676-4e21-a8e0-a7b092d1ab15 tempest-CinderUnicodeTest-1430473231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f327fdff-c0a0-4c9b-9ea8-2d0c281e986a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7418c88-5f23-40de-ae45-39759b2b2720', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:15 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-de711d4b-1676-4e21-a8e0-a7b092d1ab15 tempest-CinderUnicodeTest-1430473231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd277b44-4250-4ca2-9ba0-4ac40b6a0d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:15 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-de711d4b-1676-4e21-a8e0-a7b092d1ab15 tempest-CinderUnicodeTest-1430473231 None] Volume volume-c7418c88-5f23-40de-ae45-39759b2b2720 (c7418c88-5f23-40de-ae45-39759b2b2720): created successfully Apr 24 13:58:15 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-de711d4b-1676-4e21-a8e0-a7b092d1ab15 tempest-CinderUnicodeTest-1430473231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd277b44-4250-4ca2-9ba0-4ac40b6a0d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:15 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-de711d4b-1676-4e21-a8e0-a7b092d1ab15 tempest-CinderUnicodeTest-1430473231 None] Flow 'volume_create_manager' (31520488-4db3-4573-8fda-cab6165dd65d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:58:15 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-de711d4b-1676-4e21-a8e0-a7b092d1ab15 tempest-CinderUnicodeTest-1430473231 None] Created volume successfully. Apr 24 13:58:16 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-61516985-9926-491a-81a2-87c4841d20a2 tempest-CinderUnicodeTest-1430473231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:58:16 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-61516985-9926-491a-81a2-87c4841d20a2 tempest-CinderUnicodeTest-1430473231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:58:16 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-61516985-9926-491a-81a2-87c4841d20a2 tempest-CinderUnicodeTest-1430473231 None] Creating offline snapshot 89733b5c-47ae-4e9f-a595-29085decb3a3 of volume c7418c88-5f23-40de-ae45-39759b2b2720 {{(pid=82046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 13:58:16 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a06d05-2654-44fd-b714-ac3639387e2b]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:58:16 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-61516985-9926-491a-81a2-87c4841d20a2 tempest-CinderUnicodeTest-1430473231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c7418c88-5f23-40de-ae45-39759b2b2720 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:16 devstack sudo[90878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c7418c88-5f23-40de-ae45-39759b2b2720 Apr 24 13:58:16 devstack sudo[90878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:17 devstack sudo[90878]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-61516985-9926-491a-81a2-87c4841d20a2 tempest-CinderUnicodeTest-1430473231 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c7418c88-5f23-40de-ae45-39759b2b2720" returned: 0 in 0.683s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-61516985-9926-491a-81a2-87c4841d20a2 tempest-CinderUnicodeTest-1430473231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c7418c88-5f23-40de-ae45-39759b2b2720,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c7418c88-5f23-40de-ae45-39759b2b2720.89733b5c-47ae-4e9f-a595-29085decb3a3 1G {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:17 devstack sudo[90883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c7418c88-5f23-40de-ae45-39759b2b2720,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c7418c88-5f23-40de-ae45-39759b2b2720.89733b5c-47ae-4e9f-a595-29085decb3a3 1G Apr 24 13:58:17 devstack sudo[90883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:18 devstack sudo[90883]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:18 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-61516985-9926-491a-81a2-87c4841d20a2 tempest-CinderUnicodeTest-1430473231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c7418c88-5f23-40de-ae45-39759b2b2720,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c7418c88-5f23-40de-ae45-39759b2b2720.89733b5c-47ae-4e9f-a595-29085decb3a3 1G" returned: 0 in 0.650s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:18 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-61516985-9926-491a-81a2-87c4841d20a2 tempest-CinderUnicodeTest-1430473231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7418c88-5f23-40de-ae45-39759b2b2720 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c7418c88-5f23-40de-ae45-39759b2b2720.89733b5c-47ae-4e9f-a595-29085decb3a3 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:18 devstack sudo[90888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7418c88-5f23-40de-ae45-39759b2b2720 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c7418c88-5f23-40de-ae45-39759b2b2720.89733b5c-47ae-4e9f-a595-29085decb3a3 Apr 24 13:58:18 devstack sudo[90888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:18 devstack sudo[90888]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:18 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-61516985-9926-491a-81a2-87c4841d20a2 tempest-CinderUnicodeTest-1430473231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7418c88-5f23-40de-ae45-39759b2b2720 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c7418c88-5f23-40de-ae45-39759b2b2720.89733b5c-47ae-4e9f-a595-29085decb3a3" returned: 0 in 0.559s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:18 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-61516985-9926-491a-81a2-87c4841d20a2 tempest-CinderUnicodeTest-1430473231 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c7418c88-5f23-40de-ae45-39759b2b2720.89733b5c-47ae-4e9f-a595-29085decb3a3 is being set with open permissions: ugo+rw Apr 24 13:58:18 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-61516985-9926-491a-81a2-87c4841d20a2 tempest-CinderUnicodeTest-1430473231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c7418c88-5f23-40de-ae45-39759b2b2720.89733b5c-47ae-4e9f-a595-29085decb3a3 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:18 devstack sudo[90893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c7418c88-5f23-40de-ae45-39759b2b2720.89733b5c-47ae-4e9f-a595-29085decb3a3 Apr 24 13:58:18 devstack sudo[90893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:19 devstack sudo[90893]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-61516985-9926-491a-81a2-87c4841d20a2 tempest-CinderUnicodeTest-1430473231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c7418c88-5f23-40de-ae45-39759b2b2720.89733b5c-47ae-4e9f-a595-29085decb3a3" returned: 0 in 0.523s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-61516985-9926-491a-81a2-87c4841d20a2 tempest-CinderUnicodeTest-1430473231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c7418c88-5f23-40de-ae45-39759b2b2720.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:19 devstack sudo[90930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c7418c88-5f23-40de-ae45-39759b2b2720.info Apr 24 13:58:19 devstack sudo[90930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:19 devstack sudo[90930]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-61516985-9926-491a-81a2-87c4841d20a2 tempest-CinderUnicodeTest-1430473231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c7418c88-5f23-40de-ae45-39759b2b2720.info" returned: 0 in 0.470s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:19 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-61516985-9926-491a-81a2-87c4841d20a2 tempest-CinderUnicodeTest-1430473231 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c7418c88-5f23-40de-ae45-39759b2b2720.info is being set with open permissions: ugo+rw Apr 24 13:58:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-61516985-9926-491a-81a2-87c4841d20a2 tempest-CinderUnicodeTest-1430473231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c7418c88-5f23-40de-ae45-39759b2b2720.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:19 devstack sudo[90933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c7418c88-5f23-40de-ae45-39759b2b2720.info Apr 24 13:58:19 devstack sudo[90933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:20 devstack sudo[90933]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-61516985-9926-491a-81a2-87c4841d20a2 tempest-CinderUnicodeTest-1430473231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c7418c88-5f23-40de-ae45-39759b2b2720.info" returned: 0 in 0.493s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-61516985-9926-491a-81a2-87c4841d20a2 tempest-CinderUnicodeTest-1430473231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.482s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:58:20 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-61516985-9926-491a-81a2-87c4841d20a2 tempest-CinderUnicodeTest-1430473231 None] Create snapshot completed successfully Apr 24 13:58:20 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b768406f-6246-4340-9afb-84bff5457a7f tempest-CinderUnicodeTest-1430473231 None] Acquiring lock "cinder-89733b5c-47ae-4e9f-a595-29085decb3a3-delete_snapshot" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:58:20 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b768406f-6246-4340-9afb-84bff5457a7f tempest-CinderUnicodeTest-1430473231 None] Lock "cinder-89733b5c-47ae-4e9f-a595-29085decb3a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:58:20 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b768406f-6246-4340-9afb-84bff5457a7f tempest-CinderUnicodeTest-1430473231 None] Acquiring lock "cinder-quobyte-c7418c88-5f23-40de-ae45-39759b2b2720" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:58:20 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b768406f-6246-4340-9afb-84bff5457a7f tempest-CinderUnicodeTest-1430473231 None] Lock "cinder-quobyte-c7418c88-5f23-40de-ae45-39759b2b2720" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:58:20 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b768406f-6246-4340-9afb-84bff5457a7f tempest-CinderUnicodeTest-1430473231 None] Acquiring lock "cinder-quobyte-89733b5c-47ae-4e9f-a595-29085decb3a3" by "_delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:58:20 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b768406f-6246-4340-9afb-84bff5457a7f tempest-CinderUnicodeTest-1430473231 None] Lock "cinder-quobyte-89733b5c-47ae-4e9f-a595-29085decb3a3" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:58:20 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-b768406f-6246-4340-9afb-84bff5457a7f tempest-CinderUnicodeTest-1430473231 None] Deleting offline snapshot 89733b5c-47ae-4e9f-a595-29085decb3a3 of volume c7418c88-5f23-40de-ae45-39759b2b2720 {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 13:58:20 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-b768406f-6246-4340-9afb-84bff5457a7f tempest-CinderUnicodeTest-1430473231 None] snapshot_file for this snap is: volume-c7418c88-5f23-40de-ae45-39759b2b2720.89733b5c-47ae-4e9f-a595-29085decb3a3 {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 13:58:20 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9d4f2d-f0fc-4f2a-99a4-a1ce03b6cd51]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:58:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b768406f-6246-4340-9afb-84bff5457a7f tempest-CinderUnicodeTest-1430473231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c7418c88-5f23-40de-ae45-39759b2b2720.89733b5c-47ae-4e9f-a595-29085decb3a3 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:21 devstack sudo[90936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c7418c88-5f23-40de-ae45-39759b2b2720.89733b5c-47ae-4e9f-a595-29085decb3a3 Apr 24 13:58:21 devstack sudo[90936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:21 devstack sudo[90936]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b768406f-6246-4340-9afb-84bff5457a7f tempest-CinderUnicodeTest-1430473231 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c7418c88-5f23-40de-ae45-39759b2b2720.89733b5c-47ae-4e9f-a595-29085decb3a3" returned: 0 in 0.591s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:21 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-b768406f-6246-4340-9afb-84bff5457a7f tempest-CinderUnicodeTest-1430473231 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7418c88-5f23-40de-ae45-39759b2b2720(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:58:21 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca7bfe6-297d-4e8f-a679-d109b4770ee9]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:58:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b768406f-6246-4340-9afb-84bff5457a7f tempest-CinderUnicodeTest-1430473231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c7418c88-5f23-40de-ae45-39759b2b2720 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:21 devstack sudo[90941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c7418c88-5f23-40de-ae45-39759b2b2720 Apr 24 13:58:21 devstack sudo[90941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:22 devstack sudo[90941]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b768406f-6246-4340-9afb-84bff5457a7f tempest-CinderUnicodeTest-1430473231 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c7418c88-5f23-40de-ae45-39759b2b2720" returned: 0 in 0.643s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b768406f-6246-4340-9afb-84bff5457a7f tempest-CinderUnicodeTest-1430473231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c7418c88-5f23-40de-ae45-39759b2b2720.89733b5c-47ae-4e9f-a595-29085decb3a3 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:22 devstack sudo[90946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c7418c88-5f23-40de-ae45-39759b2b2720.89733b5c-47ae-4e9f-a595-29085decb3a3 Apr 24 13:58:22 devstack sudo[90946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:22 devstack sudo[90946]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b768406f-6246-4340-9afb-84bff5457a7f tempest-CinderUnicodeTest-1430473231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c7418c88-5f23-40de-ae45-39759b2b2720.89733b5c-47ae-4e9f-a595-29085decb3a3" returned: 0 in 0.605s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b768406f-6246-4340-9afb-84bff5457a7f tempest-CinderUnicodeTest-1430473231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c7418c88-5f23-40de-ae45-39759b2b2720.89733b5c-47ae-4e9f-a595-29085decb3a3 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:22 devstack sudo[90951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c7418c88-5f23-40de-ae45-39759b2b2720.89733b5c-47ae-4e9f-a595-29085decb3a3 Apr 24 13:58:22 devstack sudo[90951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:23 devstack sudo[90951]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:23 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b768406f-6246-4340-9afb-84bff5457a7f tempest-CinderUnicodeTest-1430473231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c7418c88-5f23-40de-ae45-39759b2b2720.89733b5c-47ae-4e9f-a595-29085decb3a3" returned: 0 in 0.539s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:23 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b768406f-6246-4340-9afb-84bff5457a7f tempest-CinderUnicodeTest-1430473231 None] Lock "cinder-quobyte-89733b5c-47ae-4e9f-a595-29085decb3a3" released by "_delete_snapshot" :: held 2.497s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:58:23 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b768406f-6246-4340-9afb-84bff5457a7f tempest-CinderUnicodeTest-1430473231 None] Lock "cinder-quobyte-c7418c88-5f23-40de-ae45-39759b2b2720" released by "delete_snapshot" :: held 2.524s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:58:23 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-b768406f-6246-4340-9afb-84bff5457a7f tempest-CinderUnicodeTest-1430473231 None] Created reservations ['7051b845-a2cf-412c-ae07-df88080d9bce', '22a680c2-b1dc-456b-a788-94e3e779d972', 'f180eaf1-1d2d-4a89-a9cd-5ca36e7f5e0d', 'be0ce19f-d7c0-496d-9342-385737075dc4'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:58:23 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-b768406f-6246-4340-9afb-84bff5457a7f tempest-CinderUnicodeTest-1430473231 None] Delete snapshot completed successfully. Apr 24 13:58:23 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b768406f-6246-4340-9afb-84bff5457a7f tempest-CinderUnicodeTest-1430473231 None] Lock "cinder-89733b5c-47ae-4e9f-a595-29085decb3a3-delete_snapshot" released by "delete_snapshot" :: held 2.689s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:58:24 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b11110df-f89a-4b0c-a0a4-2d068c447b65 tempest-CinderUnicodeTest-1430473231 None] Acquiring lock "cinder-c7418c88-5f23-40de-ae45-39759b2b2720-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:58:24 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b11110df-f89a-4b0c-a0a4-2d068c447b65 tempest-CinderUnicodeTest-1430473231 None] Lock "cinder-c7418c88-5f23-40de-ae45-39759b2b2720-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:58:24 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b11110df-f89a-4b0c-a0a4-2d068c447b65 tempest-CinderUnicodeTest-1430473231 None] Acquiring lock "cinder-quobyte-c7418c88-5f23-40de-ae45-39759b2b2720" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:58:24 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b11110df-f89a-4b0c-a0a4-2d068c447b65 tempest-CinderUnicodeTest-1430473231 None] Lock "cinder-quobyte-c7418c88-5f23-40de-ae45-39759b2b2720" acquired by "delete_volume" :: waited 0.023s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:58:24 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[b352a0c8-7c04-467d-a376-4d4795d46837]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:58:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b11110df-f89a-4b0c-a0a4-2d068c447b65 tempest-CinderUnicodeTest-1430473231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c7418c88-5f23-40de-ae45-39759b2b2720 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:24 devstack sudo[90954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c7418c88-5f23-40de-ae45-39759b2b2720 Apr 24 13:58:24 devstack sudo[90954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:24 devstack sudo[90954]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b11110df-f89a-4b0c-a0a4-2d068c447b65 tempest-CinderUnicodeTest-1430473231 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c7418c88-5f23-40de-ae45-39759b2b2720" returned: 0 in 0.601s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:24 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b11110df-f89a-4b0c-a0a4-2d068c447b65 tempest-CinderUnicodeTest-1430473231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c7418c88-5f23-40de-ae45-39759b2b2720 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:24 devstack sudo[90959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c7418c88-5f23-40de-ae45-39759b2b2720 Apr 24 13:58:24 devstack sudo[90959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:25 devstack sudo[90959]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:25 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b11110df-f89a-4b0c-a0a4-2d068c447b65 tempest-CinderUnicodeTest-1430473231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c7418c88-5f23-40de-ae45-39759b2b2720" returned: 0 in 0.501s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:25 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b11110df-f89a-4b0c-a0a4-2d068c447b65 tempest-CinderUnicodeTest-1430473231 None] Lock "cinder-quobyte-c7418c88-5f23-40de-ae45-39759b2b2720" released by "delete_volume" :: held 1.170s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:58:25 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-b11110df-f89a-4b0c-a0a4-2d068c447b65 tempest-CinderUnicodeTest-1430473231 None] Created reservations ['681368d6-dd98-423f-8645-cc0dbfb9fa6a', '4499ef27-da6d-494d-8dcb-e4afbed0910c', 'a497789d-b1d7-4efc-b462-39d228e6f2c2', '77678d90-8c8e-4a0b-81a9-95153be4169e'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:58:25 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b11110df-f89a-4b0c-a0a4-2d068c447b65 tempest-CinderUnicodeTest-1430473231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:58:25 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b11110df-f89a-4b0c-a0a4-2d068c447b65 tempest-CinderUnicodeTest-1430473231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:58:25 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b11110df-f89a-4b0c-a0a4-2d068c447b65 tempest-CinderUnicodeTest-1430473231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:58:25 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b11110df-f89a-4b0c-a0a4-2d068c447b65 tempest-CinderUnicodeTest-1430473231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:58:25 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b11110df-f89a-4b0c-a0a4-2d068c447b65 tempest-CinderUnicodeTest-1430473231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:58:25 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b11110df-f89a-4b0c-a0a4-2d068c447b65 tempest-CinderUnicodeTest-1430473231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:25 devstack sudo[90962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:58:25 devstack sudo[90962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:25 devstack sudo[90962]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:25 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b11110df-f89a-4b0c-a0a4-2d068c447b65 tempest-CinderUnicodeTest-1430473231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.502s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:25 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-b11110df-f89a-4b0c-a0a4-2d068c447b65 tempest-CinderUnicodeTest-1430473231 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:58:25 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-b11110df-f89a-4b0c-a0a4-2d068c447b65 tempest-CinderUnicodeTest-1430473231 None] Deleted volume successfully. Apr 24 13:58:25 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b11110df-f89a-4b0c-a0a4-2d068c447b65 tempest-CinderUnicodeTest-1430473231 None] Lock "cinder-c7418c88-5f23-40de-ae45-39759b2b2720-delete_volume" released by "delete_volume" :: held 1.892s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:58:26 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-750afa57-b134-4aaa-8273-01098140358c tempest-CinderUnicodeTest-1430473231 None] Acquiring lock "cinder-4e44d8a2-679e-4aef-a2cf-eeb57bc125e4-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:58:26 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-750afa57-b134-4aaa-8273-01098140358c tempest-CinderUnicodeTest-1430473231 None] Lock "cinder-4e44d8a2-679e-4aef-a2cf-eeb57bc125e4-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:58:26 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-750afa57-b134-4aaa-8273-01098140358c tempest-CinderUnicodeTest-1430473231 None] Acquiring lock "cinder-quobyte-4e44d8a2-679e-4aef-a2cf-eeb57bc125e4" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:58:26 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-750afa57-b134-4aaa-8273-01098140358c tempest-CinderUnicodeTest-1430473231 None] Lock "cinder-quobyte-4e44d8a2-679e-4aef-a2cf-eeb57bc125e4" acquired by "delete_volume" :: waited 0.016s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:58:26 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd005611-4fad-462f-9b4f-09866fdc4795]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:58:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-750afa57-b134-4aaa-8273-01098140358c tempest-CinderUnicodeTest-1430473231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4e44d8a2-679e-4aef-a2cf-eeb57bc125e4 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:26 devstack sudo[90966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4e44d8a2-679e-4aef-a2cf-eeb57bc125e4 Apr 24 13:58:26 devstack sudo[90966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:26 devstack sudo[90966]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-750afa57-b134-4aaa-8273-01098140358c tempest-CinderUnicodeTest-1430473231 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4e44d8a2-679e-4aef-a2cf-eeb57bc125e4" returned: 0 in 0.550s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-750afa57-b134-4aaa-8273-01098140358c tempest-CinderUnicodeTest-1430473231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4e44d8a2-679e-4aef-a2cf-eeb57bc125e4 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:27 devstack sudo[90971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4e44d8a2-679e-4aef-a2cf-eeb57bc125e4 Apr 24 13:58:27 devstack sudo[90971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:27 devstack sudo[90971]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:27 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-750afa57-b134-4aaa-8273-01098140358c tempest-CinderUnicodeTest-1430473231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-4e44d8a2-679e-4aef-a2cf-eeb57bc125e4" returned: 0 in 0.516s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:27 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-750afa57-b134-4aaa-8273-01098140358c tempest-CinderUnicodeTest-1430473231 None] Lock "cinder-quobyte-4e44d8a2-679e-4aef-a2cf-eeb57bc125e4" released by "delete_volume" :: held 1.109s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:58:27 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-750afa57-b134-4aaa-8273-01098140358c tempest-CinderUnicodeTest-1430473231 None] Created reservations ['9da8804b-0166-430a-b92c-795fd335aabe', '08a37868-c699-4b47-9645-0355cef2581f', 'bc1912bf-5a55-4ae4-9923-37da1d4c6a73', '8a9b3f3a-c455-45d2-a08b-e24288371db3'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:58:27 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-750afa57-b134-4aaa-8273-01098140358c tempest-CinderUnicodeTest-1430473231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:58:27 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-750afa57-b134-4aaa-8273-01098140358c tempest-CinderUnicodeTest-1430473231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:58:27 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-750afa57-b134-4aaa-8273-01098140358c tempest-CinderUnicodeTest-1430473231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:58:27 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-750afa57-b134-4aaa-8273-01098140358c tempest-CinderUnicodeTest-1430473231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:58:27 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-750afa57-b134-4aaa-8273-01098140358c tempest-CinderUnicodeTest-1430473231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:58:27 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-750afa57-b134-4aaa-8273-01098140358c tempest-CinderUnicodeTest-1430473231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:27 devstack sudo[90974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:58:27 devstack sudo[90974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:28 devstack sudo[90974]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-750afa57-b134-4aaa-8273-01098140358c tempest-CinderUnicodeTest-1430473231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.486s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:28 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-750afa57-b134-4aaa-8273-01098140358c tempest-CinderUnicodeTest-1430473231 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:58:28 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-750afa57-b134-4aaa-8273-01098140358c tempest-CinderUnicodeTest-1430473231 None] Deleted volume successfully. Apr 24 13:58:28 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-750afa57-b134-4aaa-8273-01098140358c tempest-CinderUnicodeTest-1430473231 None] Lock "cinder-4e44d8a2-679e-4aef-a2cf-eeb57bc125e4-delete_volume" released by "delete_volume" :: held 1.828s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:58:37 devstack cinder-volume[82046]: DEBUG dbcounter [-] [82046] Writing DB stats cinder:INSERT=11,cinder:UPDATE=35,cinder:SELECT=25,cinder:DELETE=3 {{(pid=82046) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 13:58:37 devstack cinder-volume[82046]: DEBUG oslo_service.periodic_task [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82046) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 13:58:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:58:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:58:37 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:58:37 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:58:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:58:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:37 devstack sudo[91020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:58:37 devstack sudo[91020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:38 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-805e0f8e-1d01-4752-9af4-dd1682bf98f8 tempest-VolumeDependencyTests-1150031044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:58:38 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-805e0f8e-1d01-4752-9af4-dd1682bf98f8 tempest-VolumeDependencyTests-1150031044 None] Flow 'volume_create_manager' (b83eb865-2873-4543-a0c8-21c9f0d54bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:58:38 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-805e0f8e-1d01-4752-9af4-dd1682bf98f8 tempest-VolumeDependencyTests-1150031044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d319dd14-f665-4e97-952b-fd0adce4c901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:38 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-805e0f8e-1d01-4752-9af4-dd1682bf98f8 tempest-VolumeDependencyTests-1150031044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d319dd14-f665-4e97-952b-fd0adce4c901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-602789043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0cab67b-8220-4294-ae29-28e0541a9e5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f005df8063f146e6a7771f312188d27b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:58:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:58:38Z,use_quota=True,user_id='f8c84f24edbc491cab1205885eab34d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:38 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-805e0f8e-1d01-4752-9af4-dd1682bf98f8 tempest-VolumeDependencyTests-1150031044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44007e34-e571-4d3a-89ae-e340929fd4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:38 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-805e0f8e-1d01-4752-9af4-dd1682bf98f8 tempest-VolumeDependencyTests-1150031044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44007e34-e571-4d3a-89ae-e340929fd4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:38 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-805e0f8e-1d01-4752-9af4-dd1682bf98f8 tempest-VolumeDependencyTests-1150031044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ff00f08-a0fc-461f-a6c0-44ed0c5b6ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:38 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-805e0f8e-1d01-4752-9af4-dd1682bf98f8 tempest-VolumeDependencyTests-1150031044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ff00f08-a0fc-461f-a6c0-44ed0c5b6ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0cab67b-8220-4294-ae29-28e0541a9e5c', 'volume_name': 'volume-c0cab67b-8220-4294-ae29-28e0541a9e5c', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:38 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-805e0f8e-1d01-4752-9af4-dd1682bf98f8 tempest-VolumeDependencyTests-1150031044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ff1ac42-8326-427e-9d8c-d6af6410d70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:38 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-805e0f8e-1d01-4752-9af4-dd1682bf98f8 tempest-VolumeDependencyTests-1150031044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ff1ac42-8326-427e-9d8c-d6af6410d70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:38 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-805e0f8e-1d01-4752-9af4-dd1682bf98f8 tempest-VolumeDependencyTests-1150031044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a56b818-e8c5-475c-b0f5-2f7e1d77cc93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:38 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-805e0f8e-1d01-4752-9af4-dd1682bf98f8 tempest-VolumeDependencyTests-1150031044 None] Volume c0cab67b-8220-4294-ae29-28e0541a9e5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0cab67b-8220-4294-ae29-28e0541a9e5c', 'volume_size': 1} Apr 24 13:58:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-805e0f8e-1d01-4752-9af4-dd1682bf98f8 tempest-VolumeDependencyTests-1150031044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:58:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-805e0f8e-1d01-4752-9af4-dd1682bf98f8 tempest-VolumeDependencyTests-1150031044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:58:38 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-805e0f8e-1d01-4752-9af4-dd1682bf98f8 tempest-VolumeDependencyTests-1150031044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-602789043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0cab67b-8220-4294-ae29-28e0541a9e5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f005df8063f146e6a7771f312188d27b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:58:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:58:38Z,use_quota=True,user_id='f8c84f24edbc491cab1205885eab34d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:58:38 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-805e0f8e-1d01-4752-9af4-dd1682bf98f8 tempest-VolumeDependencyTests-1150031044 None] Creating volume c0cab67b-8220-4294-ae29-28e0541a9e5c {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:58:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-805e0f8e-1d01-4752-9af4-dd1682bf98f8 tempest-VolumeDependencyTests-1150031044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:58:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-805e0f8e-1d01-4752-9af4-dd1682bf98f8 tempest-VolumeDependencyTests-1150031044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:58:38 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-805e0f8e-1d01-4752-9af4-dd1682bf98f8 tempest-VolumeDependencyTests-1150031044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:58:38 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-805e0f8e-1d01-4752-9af4-dd1682bf98f8 tempest-VolumeDependencyTests-1150031044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:58:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-805e0f8e-1d01-4752-9af4-dd1682bf98f8 tempest-VolumeDependencyTests-1150031044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:58:38 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-805e0f8e-1d01-4752-9af4-dd1682bf98f8 tempest-VolumeDependencyTests-1150031044 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:58:38 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-805e0f8e-1d01-4752-9af4-dd1682bf98f8 tempest-VolumeDependencyTests-1150031044 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:58:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-805e0f8e-1d01-4752-9af4-dd1682bf98f8 tempest-VolumeDependencyTests-1150031044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:38 devstack sudo[91022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c 1073741824 Apr 24 13:58:38 devstack sudo[91022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:38 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-6eb7a11c-21a5-44d7-bd4f-36eb1acf7ec2 tempest-CreateVolumesFromImageTest-1479598366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:58:38 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6eb7a11c-21a5-44d7-bd4f-36eb1acf7ec2 tempest-CreateVolumesFromImageTest-1479598366 None] Flow 'volume_create_manager' (5edce5d7-a7fa-4153-8570-ab7ea7ba38d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:58:38 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6eb7a11c-21a5-44d7-bd4f-36eb1acf7ec2 tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2d0a6ca-71fc-4280-b2c7-0df5def10b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:38 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6eb7a11c-21a5-44d7-bd4f-36eb1acf7ec2 tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2d0a6ca-71fc-4280-b2c7-0df5def10b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1547853685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30f97cb0-acda-4947-9ab9-0154da5bc324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='761c4b70a0ea470983fc155223acf1c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:58:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:58:38Z,use_quota=True,user_id='df1dc9e86d6b40b08ef9ed964b7a5da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:38 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6eb7a11c-21a5-44d7-bd4f-36eb1acf7ec2 tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7096a2b-a24a-43d9-a687-6e2b816981d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:38 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6eb7a11c-21a5-44d7-bd4f-36eb1acf7ec2 tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7096a2b-a24a-43d9-a687-6e2b816981d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:38 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6eb7a11c-21a5-44d7-bd4f-36eb1acf7ec2 tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fefd778-e6d4-42ce-bac3-3e5e71f01015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:38 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6eb7a11c-21a5-44d7-bd4f-36eb1acf7ec2 tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fefd778-e6d4-42ce-bac3-3e5e71f01015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30f97cb0-acda-4947-9ab9-0154da5bc324', 'volume_name': 'volume-30f97cb0-acda-4947-9ab9-0154da5bc324', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:38 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6eb7a11c-21a5-44d7-bd4f-36eb1acf7ec2 tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae7cafcc-aa76-4a34-9fe5-f9b73483eed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:38 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6eb7a11c-21a5-44d7-bd4f-36eb1acf7ec2 tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae7cafcc-aa76-4a34-9fe5-f9b73483eed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:38 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6eb7a11c-21a5-44d7-bd4f-36eb1acf7ec2 tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36dbf2fb-f44a-4452-b18d-6968effe9afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:38 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-6eb7a11c-21a5-44d7-bd4f-36eb1acf7ec2 tempest-CreateVolumesFromImageTest-1479598366 None] Volume 30f97cb0-acda-4947-9ab9-0154da5bc324: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30f97cb0-acda-4947-9ab9-0154da5bc324', 'volume_size': 1} Apr 24 13:58:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-6eb7a11c-21a5-44d7-bd4f-36eb1acf7ec2 tempest-CreateVolumesFromImageTest-1479598366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:58:38 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d8a173f-0957-486d-ac1c-84a52bc9ba85 tempest-CreateVolumesFromImageTest-1479598366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:58:38 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4d8a173f-0957-486d-ac1c-84a52bc9ba85 tempest-CreateVolumesFromImageTest-1479598366 None] Flow 'volume_create_manager' (3793e202-2d81-4c14-8fd2-d56b05ad0bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:58:38 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4d8a173f-0957-486d-ac1c-84a52bc9ba85 tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f121802-13be-4a65-99ef-869ada53447e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:38 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4d8a173f-0957-486d-ac1c-84a52bc9ba85 tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f121802-13be-4a65-99ef-869ada53447e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1032730429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db715aa0-d6ca-4e44-8e72-8ebc212c87ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='761c4b70a0ea470983fc155223acf1c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:58:39Z,use_quota=True,user_id='df1dc9e86d6b40b08ef9ed964b7a5da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:38 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4d8a173f-0957-486d-ac1c-84a52bc9ba85 tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74efe67a-ad74-44d0-9c2f-60e7d9de41d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:38 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4d8a173f-0957-486d-ac1c-84a52bc9ba85 tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74efe67a-ad74-44d0-9c2f-60e7d9de41d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:38 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4d8a173f-0957-486d-ac1c-84a52bc9ba85 tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d49857f-57c4-4e7e-ab1c-32acbdda3f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:38 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4d8a173f-0957-486d-ac1c-84a52bc9ba85 tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d49857f-57c4-4e7e-ab1c-32acbdda3f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db715aa0-d6ca-4e44-8e72-8ebc212c87ea', 'volume_name': 'volume-db715aa0-d6ca-4e44-8e72-8ebc212c87ea', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:38 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4d8a173f-0957-486d-ac1c-84a52bc9ba85 tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d147784-799b-4282-ba16-d11e59f7fa40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:38 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4d8a173f-0957-486d-ac1c-84a52bc9ba85 tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d147784-799b-4282-ba16-d11e59f7fa40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:38 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4d8a173f-0957-486d-ac1c-84a52bc9ba85 tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07624db4-1fa2-44b3-8417-87055adde6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:38 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-4d8a173f-0957-486d-ac1c-84a52bc9ba85 tempest-CreateVolumesFromImageTest-1479598366 None] Volume db715aa0-d6ca-4e44-8e72-8ebc212c87ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db715aa0-d6ca-4e44-8e72-8ebc212c87ea', 'volume_size': 1} Apr 24 13:58:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4d8a173f-0957-486d-ac1c-84a52bc9ba85 tempest-CreateVolumesFromImageTest-1479598366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:58:38 devstack sudo[91020]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 1.037s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:38 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:58:38 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0da1132-7d2c-40e7-8ed5-a0a83ce940c1 tempest-CreateVolumesFromSnapshotTest-323228305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:58:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e0da1132-7d2c-40e7-8ed5-a0a83ce940c1 tempest-CreateVolumesFromSnapshotTest-323228305 None] Flow 'volume_create_manager' (9db37ff7-2d53-47c7-9308-f35f738bd53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:58:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e0da1132-7d2c-40e7-8ed5-a0a83ce940c1 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c35ce333-71d1-4a2d-800d-a47335d2152f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e0da1132-7d2c-40e7-8ed5-a0a83ce940c1 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c35ce333-71d1-4a2d-800d-a47335d2152f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-57290094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c080eba-eeeb-4d7a-a592-a419809b3b8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b343905d55542e5975ceeb4e7db62b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:58:39Z,use_quota=True,user_id='a9d93529cca74aeeb26c17800ea796b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e0da1132-7d2c-40e7-8ed5-a0a83ce940c1 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e58109ca-1004-4bf6-b9e2-6584fe230642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e0da1132-7d2c-40e7-8ed5-a0a83ce940c1 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e58109ca-1004-4bf6-b9e2-6584fe230642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e0da1132-7d2c-40e7-8ed5-a0a83ce940c1 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b453b0d3-b99c-42a8-9f5f-24a8b5606de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e0da1132-7d2c-40e7-8ed5-a0a83ce940c1 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b453b0d3-b99c-42a8-9f5f-24a8b5606de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c080eba-eeeb-4d7a-a592-a419809b3b8c', 'volume_name': 'volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e0da1132-7d2c-40e7-8ed5-a0a83ce940c1 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9534bbb0-cf0c-44e8-880a-e53f05b00e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e0da1132-7d2c-40e7-8ed5-a0a83ce940c1 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9534bbb0-cf0c-44e8-880a-e53f05b00e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e0da1132-7d2c-40e7-8ed5-a0a83ce940c1 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0991c18b-2804-44de-a9c9-ddbb1817d300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:39 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-e0da1132-7d2c-40e7-8ed5-a0a83ce940c1 tempest-CreateVolumesFromSnapshotTest-323228305 None] Volume 9c080eba-eeeb-4d7a-a592-a419809b3b8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c', 'volume_size': 1} Apr 24 13:58:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-e0da1132-7d2c-40e7-8ed5-a0a83ce940c1 tempest-CreateVolumesFromSnapshotTest-323228305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:58:39 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-82429c2a-86f4-4b6d-b975-64457f6b344f tempest-CreateVolumesFromImageTest-1479598366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:58:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-82429c2a-86f4-4b6d-b975-64457f6b344f tempest-CreateVolumesFromImageTest-1479598366 None] Flow 'volume_create_manager' (bd7c49d7-c223-4d5b-8185-0e50864344b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:58:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-82429c2a-86f4-4b6d-b975-64457f6b344f tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86d4ef89-fc7a-4a42-881c-3c3a7ba39b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-82429c2a-86f4-4b6d-b975-64457f6b344f tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86d4ef89-fc7a-4a42-881c-3c3a7ba39b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1155478590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4398cf2-e075-4408-b57a-9821753c9725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='761c4b70a0ea470983fc155223acf1c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:58:39Z,use_quota=True,user_id='df1dc9e86d6b40b08ef9ed964b7a5da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-82429c2a-86f4-4b6d-b975-64457f6b344f tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c35da627-c2f6-414d-a5f5-837670e56873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-82429c2a-86f4-4b6d-b975-64457f6b344f tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c35da627-c2f6-414d-a5f5-837670e56873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-82429c2a-86f4-4b6d-b975-64457f6b344f tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bb17ea6-4f78-4ed0-a228-8107e30974f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-82429c2a-86f4-4b6d-b975-64457f6b344f tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bb17ea6-4f78-4ed0-a228-8107e30974f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4398cf2-e075-4408-b57a-9821753c9725', 'volume_name': 'volume-c4398cf2-e075-4408-b57a-9821753c9725', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-82429c2a-86f4-4b6d-b975-64457f6b344f tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0664b8d3-5260-4cd6-b2e4-974a362972bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-82429c2a-86f4-4b6d-b975-64457f6b344f tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0664b8d3-5260-4cd6-b2e4-974a362972bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-82429c2a-86f4-4b6d-b975-64457f6b344f tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (148530d3-953e-4139-9b50-9fd71e17cf9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:39 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-82429c2a-86f4-4b6d-b975-64457f6b344f tempest-CreateVolumesFromImageTest-1479598366 None] Volume c4398cf2-e075-4408-b57a-9821753c9725: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4398cf2-e075-4408-b57a-9821753c9725', 'volume_size': 1} Apr 24 13:58:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-82429c2a-86f4-4b6d-b975-64457f6b344f tempest-CreateVolumesFromImageTest-1479598366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:58:39 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-008c645e-1222-46b3-b6b7-00363003a6a0 tempest-CreateVolumesFromImageTest-1479598366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:58:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-008c645e-1222-46b3-b6b7-00363003a6a0 tempest-CreateVolumesFromImageTest-1479598366 None] Flow 'volume_create_manager' (47872d8b-81ef-44c4-ab78-3eeddd3f8a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:58:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-008c645e-1222-46b3-b6b7-00363003a6a0 tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e6781b7-2248-447f-aac2-57d611d4bf5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-008c645e-1222-46b3-b6b7-00363003a6a0 tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e6781b7-2248-447f-aac2-57d611d4bf5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-823846289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21e6dc20-548b-4f1e-bc48-3e4d08b00527,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='761c4b70a0ea470983fc155223acf1c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:58:40Z,use_quota=True,user_id='df1dc9e86d6b40b08ef9ed964b7a5da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-008c645e-1222-46b3-b6b7-00363003a6a0 tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddfc14c5-e7f2-460a-9bd1-675bb29eff1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-008c645e-1222-46b3-b6b7-00363003a6a0 tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddfc14c5-e7f2-460a-9bd1-675bb29eff1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-008c645e-1222-46b3-b6b7-00363003a6a0 tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4d5c1fc-75f3-40ca-965b-e7b14ab8e395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-008c645e-1222-46b3-b6b7-00363003a6a0 tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4d5c1fc-75f3-40ca-965b-e7b14ab8e395) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21e6dc20-548b-4f1e-bc48-3e4d08b00527', 'volume_name': 'volume-21e6dc20-548b-4f1e-bc48-3e4d08b00527', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:39 devstack sudo[91022]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-008c645e-1222-46b3-b6b7-00363003a6a0 tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12ef2af8-83d2-4af5-bdd7-796d17433c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-008c645e-1222-46b3-b6b7-00363003a6a0 tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12ef2af8-83d2-4af5-bdd7-796d17433c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:39 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-008c645e-1222-46b3-b6b7-00363003a6a0 tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7f0a3f7-ce8f-42f9-a952-627e3a643481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:39 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-008c645e-1222-46b3-b6b7-00363003a6a0 tempest-CreateVolumesFromImageTest-1479598366 None] Volume 21e6dc20-548b-4f1e-bc48-3e4d08b00527: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21e6dc20-548b-4f1e-bc48-3e4d08b00527', 'volume_size': 1} Apr 24 13:58:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-008c645e-1222-46b3-b6b7-00363003a6a0 tempest-CreateVolumesFromImageTest-1479598366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:58:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-805e0f8e-1d01-4752-9af4-dd1682bf98f8 tempest-VolumeDependencyTests-1150031044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c 1073741824" returned: 0 in 1.416s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-805e0f8e-1d01-4752-9af4-dd1682bf98f8 tempest-VolumeDependencyTests-1150031044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:39 devstack sudo[91028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c Apr 24 13:58:39 devstack sudo[91028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:40 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8caf99b-312f-4b11-bf9a-a96dcda3505e tempest-CreateVolumesFromImageTest-1479598366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:58:40 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a8caf99b-312f-4b11-bf9a-a96dcda3505e tempest-CreateVolumesFromImageTest-1479598366 None] Flow 'volume_create_manager' (66b8f425-f43a-4123-b82a-f10e0a8197b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:58:40 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a8caf99b-312f-4b11-bf9a-a96dcda3505e tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f36efe35-aa7b-481d-888a-dd3484993006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:40 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a8caf99b-312f-4b11-bf9a-a96dcda3505e tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f36efe35-aa7b-481d-888a-dd3484993006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1859051145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15808b6a-647e-4baa-a2a4-540b777b01b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='761c4b70a0ea470983fc155223acf1c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:58:40Z,use_quota=True,user_id='df1dc9e86d6b40b08ef9ed964b7a5da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:40 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a8caf99b-312f-4b11-bf9a-a96dcda3505e tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00a50e13-a6c3-43cc-9825-48babceadf7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:40 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a8caf99b-312f-4b11-bf9a-a96dcda3505e tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00a50e13-a6c3-43cc-9825-48babceadf7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:40 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a8caf99b-312f-4b11-bf9a-a96dcda3505e tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f6a5eab-099e-4284-ac9f-f0d583300342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:40 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a8caf99b-312f-4b11-bf9a-a96dcda3505e tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f6a5eab-099e-4284-ac9f-f0d583300342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15808b6a-647e-4baa-a2a4-540b777b01b5', 'volume_name': 'volume-15808b6a-647e-4baa-a2a4-540b777b01b5', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:40 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a8caf99b-312f-4b11-bf9a-a96dcda3505e tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (228408ca-6c4e-48a9-b00e-3c074db4e89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:40 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a8caf99b-312f-4b11-bf9a-a96dcda3505e tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (228408ca-6c4e-48a9-b00e-3c074db4e89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:40 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a8caf99b-312f-4b11-bf9a-a96dcda3505e tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0242d1a0-3f3b-4f46-84f6-c25657b249c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:40 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-a8caf99b-312f-4b11-bf9a-a96dcda3505e tempest-CreateVolumesFromImageTest-1479598366 None] Volume 15808b6a-647e-4baa-a2a4-540b777b01b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15808b6a-647e-4baa-a2a4-540b777b01b5', 'volume_size': 1} Apr 24 13:58:40 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a8caf99b-312f-4b11-bf9a-a96dcda3505e tempest-CreateVolumesFromImageTest-1479598366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:58:40 devstack sudo[91028]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:40 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-805e0f8e-1d01-4752-9af4-dd1682bf98f8 tempest-VolumeDependencyTests-1150031044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c" returned: 0 in 0.610s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:40 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-805e0f8e-1d01-4752-9af4-dd1682bf98f8 tempest-VolumeDependencyTests-1150031044 None] <== create_volume: return (2135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:58:40 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-805e0f8e-1d01-4752-9af4-dd1682bf98f8 tempest-VolumeDependencyTests-1150031044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.143s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:58:40 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-6eb7a11c-21a5-44d7-bd4f-36eb1acf7ec2 tempest-CreateVolumesFromImageTest-1479598366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.705s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:58:40 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-6eb7a11c-21a5-44d7-bd4f-36eb1acf7ec2 tempest-CreateVolumesFromImageTest-1479598366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1547853685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30f97cb0-acda-4947-9ab9-0154da5bc324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='761c4b70a0ea470983fc155223acf1c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:58:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:58:38Z,use_quota=True,user_id='df1dc9e86d6b40b08ef9ed964b7a5da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:58:40 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-6eb7a11c-21a5-44d7-bd4f-36eb1acf7ec2 tempest-CreateVolumesFromImageTest-1479598366 None] Creating volume 30f97cb0-acda-4947-9ab9-0154da5bc324 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:58:40 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-6eb7a11c-21a5-44d7-bd4f-36eb1acf7ec2 tempest-CreateVolumesFromImageTest-1479598366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:58:40 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-6eb7a11c-21a5-44d7-bd4f-36eb1acf7ec2 tempest-CreateVolumesFromImageTest-1479598366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:58:40 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-6eb7a11c-21a5-44d7-bd4f-36eb1acf7ec2 tempest-CreateVolumesFromImageTest-1479598366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:58:40 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-6eb7a11c-21a5-44d7-bd4f-36eb1acf7ec2 tempest-CreateVolumesFromImageTest-1479598366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:58:40 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-6eb7a11c-21a5-44d7-bd4f-36eb1acf7ec2 tempest-CreateVolumesFromImageTest-1479598366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:58:40 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-6eb7a11c-21a5-44d7-bd4f-36eb1acf7ec2 tempest-CreateVolumesFromImageTest-1479598366 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:58:40 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-6eb7a11c-21a5-44d7-bd4f-36eb1acf7ec2 tempest-CreateVolumesFromImageTest-1479598366 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:58:40 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6eb7a11c-21a5-44d7-bd4f-36eb1acf7ec2 tempest-CreateVolumesFromImageTest-1479598366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30f97cb0-acda-4947-9ab9-0154da5bc324 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:40 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-805e0f8e-1d01-4752-9af4-dd1682bf98f8 tempest-VolumeDependencyTests-1150031044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a56b818-e8c5-475c-b0f5-2f7e1d77cc93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0cab67b-8220-4294-ae29-28e0541a9e5c', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:40 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-805e0f8e-1d01-4752-9af4-dd1682bf98f8 tempest-VolumeDependencyTests-1150031044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f624b95a-6656-4cf5-ae74-025369af8a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:40 devstack sudo[91031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30f97cb0-acda-4947-9ab9-0154da5bc324 1073741824 Apr 24 13:58:40 devstack sudo[91031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:40 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-805e0f8e-1d01-4752-9af4-dd1682bf98f8 tempest-VolumeDependencyTests-1150031044 None] Volume volume-c0cab67b-8220-4294-ae29-28e0541a9e5c (c0cab67b-8220-4294-ae29-28e0541a9e5c): created successfully Apr 24 13:58:40 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-805e0f8e-1d01-4752-9af4-dd1682bf98f8 tempest-VolumeDependencyTests-1150031044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f624b95a-6656-4cf5-ae74-025369af8a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:40 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-805e0f8e-1d01-4752-9af4-dd1682bf98f8 tempest-VolumeDependencyTests-1150031044 None] Flow 'volume_create_manager' (b83eb865-2873-4543-a0c8-21c9f0d54bca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:58:40 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-805e0f8e-1d01-4752-9af4-dd1682bf98f8 tempest-VolumeDependencyTests-1150031044 None] Created volume successfully. Apr 24 13:58:41 devstack sudo[91031]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6eb7a11c-21a5-44d7-bd4f-36eb1acf7ec2 tempest-CreateVolumesFromImageTest-1479598366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30f97cb0-acda-4947-9ab9-0154da5bc324 1073741824" returned: 0 in 0.920s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6eb7a11c-21a5-44d7-bd4f-36eb1acf7ec2 tempest-CreateVolumesFromImageTest-1479598366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30f97cb0-acda-4947-9ab9-0154da5bc324 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:41 devstack sudo[91036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30f97cb0-acda-4947-9ab9-0154da5bc324 Apr 24 13:58:41 devstack sudo[91036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-69aeb525-b44c-4a37-aa38-23c127d24f26 tempest-VolumeDependencyTests-1150031044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:58:41 devstack sudo[91036]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6eb7a11c-21a5-44d7-bd4f-36eb1acf7ec2 tempest-CreateVolumesFromImageTest-1479598366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30f97cb0-acda-4947-9ab9-0154da5bc324" returned: 0 in 0.589s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:41 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-6eb7a11c-21a5-44d7-bd4f-36eb1acf7ec2 tempest-CreateVolumesFromImageTest-1479598366 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:58:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-6eb7a11c-21a5-44d7-bd4f-36eb1acf7ec2 tempest-CreateVolumesFromImageTest-1479598366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:58:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4d8a173f-0957-486d-ac1c-84a52bc9ba85 tempest-CreateVolumesFromImageTest-1479598366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.034s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:58:41 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-4d8a173f-0957-486d-ac1c-84a52bc9ba85 tempest-CreateVolumesFromImageTest-1479598366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1032730429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db715aa0-d6ca-4e44-8e72-8ebc212c87ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='761c4b70a0ea470983fc155223acf1c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:58:39Z,use_quota=True,user_id='df1dc9e86d6b40b08ef9ed964b7a5da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:58:41 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-4d8a173f-0957-486d-ac1c-84a52bc9ba85 tempest-CreateVolumesFromImageTest-1479598366 None] Creating volume db715aa0-d6ca-4e44-8e72-8ebc212c87ea {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:58:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4d8a173f-0957-486d-ac1c-84a52bc9ba85 tempest-CreateVolumesFromImageTest-1479598366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:58:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4d8a173f-0957-486d-ac1c-84a52bc9ba85 tempest-CreateVolumesFromImageTest-1479598366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:58:41 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-4d8a173f-0957-486d-ac1c-84a52bc9ba85 tempest-CreateVolumesFromImageTest-1479598366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:58:41 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-4d8a173f-0957-486d-ac1c-84a52bc9ba85 tempest-CreateVolumesFromImageTest-1479598366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:58:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4d8a173f-0957-486d-ac1c-84a52bc9ba85 tempest-CreateVolumesFromImageTest-1479598366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:58:41 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-4d8a173f-0957-486d-ac1c-84a52bc9ba85 tempest-CreateVolumesFromImageTest-1479598366 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:58:41 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-4d8a173f-0957-486d-ac1c-84a52bc9ba85 tempest-CreateVolumesFromImageTest-1479598366 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:58:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4d8a173f-0957-486d-ac1c-84a52bc9ba85 tempest-CreateVolumesFromImageTest-1479598366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-db715aa0-d6ca-4e44-8e72-8ebc212c87ea 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:41 devstack sudo[91039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-db715aa0-d6ca-4e44-8e72-8ebc212c87ea 1073741824 Apr 24 13:58:41 devstack sudo[91039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:41 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6eb7a11c-21a5-44d7-bd4f-36eb1acf7ec2 tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36dbf2fb-f44a-4452-b18d-6968effe9afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30f97cb0-acda-4947-9ab9-0154da5bc324', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:42 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6eb7a11c-21a5-44d7-bd4f-36eb1acf7ec2 tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71509a9b-b9c5-4b4b-943b-fd53bd3c48ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:42 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-6eb7a11c-21a5-44d7-bd4f-36eb1acf7ec2 tempest-CreateVolumesFromImageTest-1479598366 None] Volume volume-30f97cb0-acda-4947-9ab9-0154da5bc324 (30f97cb0-acda-4947-9ab9-0154da5bc324): created successfully Apr 24 13:58:42 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6eb7a11c-21a5-44d7-bd4f-36eb1acf7ec2 tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71509a9b-b9c5-4b4b-943b-fd53bd3c48ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:42 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-6eb7a11c-21a5-44d7-bd4f-36eb1acf7ec2 tempest-CreateVolumesFromImageTest-1479598366 None] Flow 'volume_create_manager' (5edce5d7-a7fa-4153-8570-ab7ea7ba38d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:58:42 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-6eb7a11c-21a5-44d7-bd4f-36eb1acf7ec2 tempest-CreateVolumesFromImageTest-1479598366 None] Created volume successfully. Apr 24 13:58:42 devstack sudo[91039]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:42 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4d8a173f-0957-486d-ac1c-84a52bc9ba85 tempest-CreateVolumesFromImageTest-1479598366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-db715aa0-d6ca-4e44-8e72-8ebc212c87ea 1073741824" returned: 0 in 0.795s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:42 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4d8a173f-0957-486d-ac1c-84a52bc9ba85 tempest-CreateVolumesFromImageTest-1479598366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-db715aa0-d6ca-4e44-8e72-8ebc212c87ea {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:42 devstack sudo[91044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-db715aa0-d6ca-4e44-8e72-8ebc212c87ea Apr 24 13:58:42 devstack sudo[91044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:43 devstack sudo[91044]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4d8a173f-0957-486d-ac1c-84a52bc9ba85 tempest-CreateVolumesFromImageTest-1479598366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-db715aa0-d6ca-4e44-8e72-8ebc212c87ea" returned: 0 in 0.541s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:43 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-4d8a173f-0957-486d-ac1c-84a52bc9ba85 tempest-CreateVolumesFromImageTest-1479598366 None] <== create_volume: return (1383ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:58:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4d8a173f-0957-486d-ac1c-84a52bc9ba85 tempest-CreateVolumesFromImageTest-1479598366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.386s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:58:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-e0da1132-7d2c-40e7-8ed5-a0a83ce940c1 tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.181s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:58:43 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-e0da1132-7d2c-40e7-8ed5-a0a83ce940c1 tempest-CreateVolumesFromSnapshotTest-323228305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-57290094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c080eba-eeeb-4d7a-a592-a419809b3b8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b343905d55542e5975ceeb4e7db62b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:58:39Z,use_quota=True,user_id='a9d93529cca74aeeb26c17800ea796b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:58:43 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-e0da1132-7d2c-40e7-8ed5-a0a83ce940c1 tempest-CreateVolumesFromSnapshotTest-323228305 None] Creating volume 9c080eba-eeeb-4d7a-a592-a419809b3b8c {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:58:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-e0da1132-7d2c-40e7-8ed5-a0a83ce940c1 tempest-CreateVolumesFromSnapshotTest-323228305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:58:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-e0da1132-7d2c-40e7-8ed5-a0a83ce940c1 tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:58:43 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-e0da1132-7d2c-40e7-8ed5-a0a83ce940c1 tempest-CreateVolumesFromSnapshotTest-323228305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:58:43 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-e0da1132-7d2c-40e7-8ed5-a0a83ce940c1 tempest-CreateVolumesFromSnapshotTest-323228305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:58:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-e0da1132-7d2c-40e7-8ed5-a0a83ce940c1 tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:58:43 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-e0da1132-7d2c-40e7-8ed5-a0a83ce940c1 tempest-CreateVolumesFromSnapshotTest-323228305 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:58:43 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-e0da1132-7d2c-40e7-8ed5-a0a83ce940c1 tempest-CreateVolumesFromSnapshotTest-323228305 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:58:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e0da1132-7d2c-40e7-8ed5-a0a83ce940c1 tempest-CreateVolumesFromSnapshotTest-323228305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:43 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4d8a173f-0957-486d-ac1c-84a52bc9ba85 tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07624db4-1fa2-44b3-8417-87055adde6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db715aa0-d6ca-4e44-8e72-8ebc212c87ea', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:43 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4d8a173f-0957-486d-ac1c-84a52bc9ba85 tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cdba53a-2804-415a-8a1f-752f6715cd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:43 devstack sudo[91048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c 1073741824 Apr 24 13:58:43 devstack sudo[91048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:43 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-4d8a173f-0957-486d-ac1c-84a52bc9ba85 tempest-CreateVolumesFromImageTest-1479598366 None] Volume volume-db715aa0-d6ca-4e44-8e72-8ebc212c87ea (db715aa0-d6ca-4e44-8e72-8ebc212c87ea): created successfully Apr 24 13:58:43 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4d8a173f-0957-486d-ac1c-84a52bc9ba85 tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cdba53a-2804-415a-8a1f-752f6715cd48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:43 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4d8a173f-0957-486d-ac1c-84a52bc9ba85 tempest-CreateVolumesFromImageTest-1479598366 None] Flow 'volume_create_manager' (3793e202-2d81-4c14-8fd2-d56b05ad0bd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:58:43 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-4d8a173f-0957-486d-ac1c-84a52bc9ba85 tempest-CreateVolumesFromImageTest-1479598366 None] Created volume successfully. Apr 24 13:58:44 devstack sudo[91048]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e0da1132-7d2c-40e7-8ed5-a0a83ce940c1 tempest-CreateVolumesFromSnapshotTest-323228305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c 1073741824" returned: 0 in 0.801s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e0da1132-7d2c-40e7-8ed5-a0a83ce940c1 tempest-CreateVolumesFromSnapshotTest-323228305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:44 devstack sudo[91053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c Apr 24 13:58:44 devstack sudo[91053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:44 devstack sudo[91053]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e0da1132-7d2c-40e7-8ed5-a0a83ce940c1 tempest-CreateVolumesFromSnapshotTest-323228305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c" returned: 0 in 0.634s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:44 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-e0da1132-7d2c-40e7-8ed5-a0a83ce940c1 tempest-CreateVolumesFromSnapshotTest-323228305 None] <== create_volume: return (1604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:58:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-e0da1132-7d2c-40e7-8ed5-a0a83ce940c1 tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.607s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:58:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-82429c2a-86f4-4b6d-b975-64457f6b344f tempest-CreateVolumesFromImageTest-1479598366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.676s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:58:44 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-82429c2a-86f4-4b6d-b975-64457f6b344f tempest-CreateVolumesFromImageTest-1479598366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1155478590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4398cf2-e075-4408-b57a-9821753c9725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='761c4b70a0ea470983fc155223acf1c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:58:39Z,use_quota=True,user_id='df1dc9e86d6b40b08ef9ed964b7a5da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:58:44 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-82429c2a-86f4-4b6d-b975-64457f6b344f tempest-CreateVolumesFromImageTest-1479598366 None] Creating volume c4398cf2-e075-4408-b57a-9821753c9725 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:58:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-82429c2a-86f4-4b6d-b975-64457f6b344f tempest-CreateVolumesFromImageTest-1479598366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:58:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-82429c2a-86f4-4b6d-b975-64457f6b344f tempest-CreateVolumesFromImageTest-1479598366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:58:44 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-82429c2a-86f4-4b6d-b975-64457f6b344f tempest-CreateVolumesFromImageTest-1479598366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:58:44 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-82429c2a-86f4-4b6d-b975-64457f6b344f tempest-CreateVolumesFromImageTest-1479598366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:58:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-82429c2a-86f4-4b6d-b975-64457f6b344f tempest-CreateVolumesFromImageTest-1479598366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:58:44 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-82429c2a-86f4-4b6d-b975-64457f6b344f tempest-CreateVolumesFromImageTest-1479598366 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:58:44 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-82429c2a-86f4-4b6d-b975-64457f6b344f tempest-CreateVolumesFromImageTest-1479598366 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:58:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-82429c2a-86f4-4b6d-b975-64457f6b344f tempest-CreateVolumesFromImageTest-1479598366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c4398cf2-e075-4408-b57a-9821753c9725 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:44 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e0da1132-7d2c-40e7-8ed5-a0a83ce940c1 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0991c18b-2804-44de-a9c9-ddbb1817d300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:44 devstack sudo[91056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c4398cf2-e075-4408-b57a-9821753c9725 1073741824 Apr 24 13:58:44 devstack sudo[91056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:44 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e0da1132-7d2c-40e7-8ed5-a0a83ce940c1 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (731917a1-188f-4ffa-b8c9-ecc52abb21cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:45 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-e0da1132-7d2c-40e7-8ed5-a0a83ce940c1 tempest-CreateVolumesFromSnapshotTest-323228305 None] Volume volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c (9c080eba-eeeb-4d7a-a592-a419809b3b8c): created successfully Apr 24 13:58:45 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e0da1132-7d2c-40e7-8ed5-a0a83ce940c1 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (731917a1-188f-4ffa-b8c9-ecc52abb21cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:45 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e0da1132-7d2c-40e7-8ed5-a0a83ce940c1 tempest-CreateVolumesFromSnapshotTest-323228305 None] Flow 'volume_create_manager' (9db37ff7-2d53-47c7-9308-f35f738bd53a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:58:45 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-e0da1132-7d2c-40e7-8ed5-a0a83ce940c1 tempest-CreateVolumesFromSnapshotTest-323228305 None] Created volume successfully. Apr 24 13:58:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-bb552482-3c3e-4e92-885b-329fa337a055 tempest-CreateVolumesFromSnapshotTest-323228305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:58:45 devstack sudo[91056]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-82429c2a-86f4-4b6d-b975-64457f6b344f tempest-CreateVolumesFromImageTest-1479598366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c4398cf2-e075-4408-b57a-9821753c9725 1073741824" returned: 0 in 0.954s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-82429c2a-86f4-4b6d-b975-64457f6b344f tempest-CreateVolumesFromImageTest-1479598366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c4398cf2-e075-4408-b57a-9821753c9725 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:45 devstack sudo[91062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c4398cf2-e075-4408-b57a-9821753c9725 Apr 24 13:58:45 devstack sudo[91062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:46 devstack sudo[91062]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:46 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-82429c2a-86f4-4b6d-b975-64457f6b344f tempest-CreateVolumesFromImageTest-1479598366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c4398cf2-e075-4408-b57a-9821753c9725" returned: 0 in 0.649s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:46 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-82429c2a-86f4-4b6d-b975-64457f6b344f tempest-CreateVolumesFromImageTest-1479598366 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:58:46 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-82429c2a-86f4-4b6d-b975-64457f6b344f tempest-CreateVolumesFromImageTest-1479598366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.651s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:58:46 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-008c645e-1222-46b3-b6b7-00363003a6a0 tempest-CreateVolumesFromImageTest-1479598366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.944s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:58:46 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-008c645e-1222-46b3-b6b7-00363003a6a0 tempest-CreateVolumesFromImageTest-1479598366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-823846289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21e6dc20-548b-4f1e-bc48-3e4d08b00527,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='761c4b70a0ea470983fc155223acf1c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:58:40Z,use_quota=True,user_id='df1dc9e86d6b40b08ef9ed964b7a5da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:58:46 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-008c645e-1222-46b3-b6b7-00363003a6a0 tempest-CreateVolumesFromImageTest-1479598366 None] Creating volume 21e6dc20-548b-4f1e-bc48-3e4d08b00527 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:58:46 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-008c645e-1222-46b3-b6b7-00363003a6a0 tempest-CreateVolumesFromImageTest-1479598366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:58:46 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-008c645e-1222-46b3-b6b7-00363003a6a0 tempest-CreateVolumesFromImageTest-1479598366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:58:46 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-008c645e-1222-46b3-b6b7-00363003a6a0 tempest-CreateVolumesFromImageTest-1479598366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:58:46 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-008c645e-1222-46b3-b6b7-00363003a6a0 tempest-CreateVolumesFromImageTest-1479598366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:58:46 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-008c645e-1222-46b3-b6b7-00363003a6a0 tempest-CreateVolumesFromImageTest-1479598366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:58:46 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-008c645e-1222-46b3-b6b7-00363003a6a0 tempest-CreateVolumesFromImageTest-1479598366 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:58:46 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-008c645e-1222-46b3-b6b7-00363003a6a0 tempest-CreateVolumesFromImageTest-1479598366 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:58:46 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-008c645e-1222-46b3-b6b7-00363003a6a0 tempest-CreateVolumesFromImageTest-1479598366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-21e6dc20-548b-4f1e-bc48-3e4d08b00527 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:46 devstack sudo[91065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-21e6dc20-548b-4f1e-bc48-3e4d08b00527 1073741824 Apr 24 13:58:46 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-82429c2a-86f4-4b6d-b975-64457f6b344f tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (148530d3-953e-4139-9b50-9fd71e17cf9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4398cf2-e075-4408-b57a-9821753c9725', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:46 devstack sudo[91065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:46 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-82429c2a-86f4-4b6d-b975-64457f6b344f tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77058924-cfe4-4e63-82a0-2bde49141ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:46 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-82429c2a-86f4-4b6d-b975-64457f6b344f tempest-CreateVolumesFromImageTest-1479598366 None] Volume volume-c4398cf2-e075-4408-b57a-9821753c9725 (c4398cf2-e075-4408-b57a-9821753c9725): created successfully Apr 24 13:58:46 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-82429c2a-86f4-4b6d-b975-64457f6b344f tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77058924-cfe4-4e63-82a0-2bde49141ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:46 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-82429c2a-86f4-4b6d-b975-64457f6b344f tempest-CreateVolumesFromImageTest-1479598366 None] Flow 'volume_create_manager' (bd7c49d7-c223-4d5b-8185-0e50864344b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:58:46 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-82429c2a-86f4-4b6d-b975-64457f6b344f tempest-CreateVolumesFromImageTest-1479598366 None] Created volume successfully. Apr 24 13:58:47 devstack sudo[91065]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-008c645e-1222-46b3-b6b7-00363003a6a0 tempest-CreateVolumesFromImageTest-1479598366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-21e6dc20-548b-4f1e-bc48-3e4d08b00527 1073741824" returned: 0 in 0.830s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-008c645e-1222-46b3-b6b7-00363003a6a0 tempest-CreateVolumesFromImageTest-1479598366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-21e6dc20-548b-4f1e-bc48-3e4d08b00527 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:47 devstack sudo[91070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-21e6dc20-548b-4f1e-bc48-3e4d08b00527 Apr 24 13:58:47 devstack sudo[91070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:48 devstack sudo[91070]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-008c645e-1222-46b3-b6b7-00363003a6a0 tempest-CreateVolumesFromImageTest-1479598366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-21e6dc20-548b-4f1e-bc48-3e4d08b00527" returned: 0 in 0.685s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:48 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-008c645e-1222-46b3-b6b7-00363003a6a0 tempest-CreateVolumesFromImageTest-1479598366 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:58:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-008c645e-1222-46b3-b6b7-00363003a6a0 tempest-CreateVolumesFromImageTest-1479598366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:58:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a8caf99b-312f-4b11-bf9a-a96dcda3505e tempest-CreateVolumesFromImageTest-1479598366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.080s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:58:48 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a8caf99b-312f-4b11-bf9a-a96dcda3505e tempest-CreateVolumesFromImageTest-1479598366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1859051145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15808b6a-647e-4baa-a2a4-540b777b01b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='761c4b70a0ea470983fc155223acf1c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:58:40Z,use_quota=True,user_id='df1dc9e86d6b40b08ef9ed964b7a5da8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:58:48 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-a8caf99b-312f-4b11-bf9a-a96dcda3505e tempest-CreateVolumesFromImageTest-1479598366 None] Creating volume 15808b6a-647e-4baa-a2a4-540b777b01b5 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:58:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a8caf99b-312f-4b11-bf9a-a96dcda3505e tempest-CreateVolumesFromImageTest-1479598366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:58:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a8caf99b-312f-4b11-bf9a-a96dcda3505e tempest-CreateVolumesFromImageTest-1479598366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:58:48 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a8caf99b-312f-4b11-bf9a-a96dcda3505e tempest-CreateVolumesFromImageTest-1479598366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:58:48 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a8caf99b-312f-4b11-bf9a-a96dcda3505e tempest-CreateVolumesFromImageTest-1479598366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:58:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a8caf99b-312f-4b11-bf9a-a96dcda3505e tempest-CreateVolumesFromImageTest-1479598366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:58:48 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a8caf99b-312f-4b11-bf9a-a96dcda3505e tempest-CreateVolumesFromImageTest-1479598366 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:58:48 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-a8caf99b-312f-4b11-bf9a-a96dcda3505e tempest-CreateVolumesFromImageTest-1479598366 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:58:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a8caf99b-312f-4b11-bf9a-a96dcda3505e tempest-CreateVolumesFromImageTest-1479598366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-15808b6a-647e-4baa-a2a4-540b777b01b5 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:48 devstack sudo[91073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-15808b6a-647e-4baa-a2a4-540b777b01b5 1073741824 Apr 24 13:58:48 devstack sudo[91073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:48 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-008c645e-1222-46b3-b6b7-00363003a6a0 tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7f0a3f7-ce8f-42f9-a952-627e3a643481) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21e6dc20-548b-4f1e-bc48-3e4d08b00527', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:48 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-008c645e-1222-46b3-b6b7-00363003a6a0 tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea6fc289-3850-4558-872c-9c0945962da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:48 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-008c645e-1222-46b3-b6b7-00363003a6a0 tempest-CreateVolumesFromImageTest-1479598366 None] Volume volume-21e6dc20-548b-4f1e-bc48-3e4d08b00527 (21e6dc20-548b-4f1e-bc48-3e4d08b00527): created successfully Apr 24 13:58:48 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-008c645e-1222-46b3-b6b7-00363003a6a0 tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea6fc289-3850-4558-872c-9c0945962da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:48 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-008c645e-1222-46b3-b6b7-00363003a6a0 tempest-CreateVolumesFromImageTest-1479598366 None] Flow 'volume_create_manager' (47872d8b-81ef-44c4-ab78-3eeddd3f8a52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:58:48 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-008c645e-1222-46b3-b6b7-00363003a6a0 tempest-CreateVolumesFromImageTest-1479598366 None] Created volume successfully. Apr 24 13:58:48 devstack sudo[91073]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a8caf99b-312f-4b11-bf9a-a96dcda3505e tempest-CreateVolumesFromImageTest-1479598366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-15808b6a-647e-4baa-a2a4-540b777b01b5 1073741824" returned: 0 in 0.806s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a8caf99b-312f-4b11-bf9a-a96dcda3505e tempest-CreateVolumesFromImageTest-1479598366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-15808b6a-647e-4baa-a2a4-540b777b01b5 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:49 devstack sudo[91078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-15808b6a-647e-4baa-a2a4-540b777b01b5 Apr 24 13:58:49 devstack sudo[91078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:49 devstack sudo[91078]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a8caf99b-312f-4b11-bf9a-a96dcda3505e tempest-CreateVolumesFromImageTest-1479598366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-15808b6a-647e-4baa-a2a4-540b777b01b5" returned: 0 in 0.580s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:49 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a8caf99b-312f-4b11-bf9a-a96dcda3505e tempest-CreateVolumesFromImageTest-1479598366 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:58:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a8caf99b-312f-4b11-bf9a-a96dcda3505e tempest-CreateVolumesFromImageTest-1479598366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.460s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:58:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-69aeb525-b44c-4a37-aa38-23c127d24f26 tempest-VolumeDependencyTests-1150031044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.100s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:58:49 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a8caf99b-312f-4b11-bf9a-a96dcda3505e tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0242d1a0-3f3b-4f46-84f6-c25657b249c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15808b6a-647e-4baa-a2a4-540b777b01b5', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:49 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a8caf99b-312f-4b11-bf9a-a96dcda3505e tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bd23aea-8e47-4229-96eb-1980ce600e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:49 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-a8caf99b-312f-4b11-bf9a-a96dcda3505e tempest-CreateVolumesFromImageTest-1479598366 None] Volume volume-15808b6a-647e-4baa-a2a4-540b777b01b5 (15808b6a-647e-4baa-a2a4-540b777b01b5): created successfully Apr 24 13:58:49 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a8caf99b-312f-4b11-bf9a-a96dcda3505e tempest-CreateVolumesFromImageTest-1479598366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bd23aea-8e47-4229-96eb-1980ce600e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:49 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a8caf99b-312f-4b11-bf9a-a96dcda3505e tempest-CreateVolumesFromImageTest-1479598366 None] Flow 'volume_create_manager' (66b8f425-f43a-4123-b82a-f10e0a8197b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:58:49 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-69aeb525-b44c-4a37-aa38-23c127d24f26 tempest-VolumeDependencyTests-1150031044 None] Creating offline snapshot 39dca2e5-db0e-4e48-8dc3-d615ef6299a3 of volume c0cab67b-8220-4294-ae29-28e0541a9e5c {{(pid=82046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 13:58:49 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-a8caf99b-312f-4b11-bf9a-a96dcda3505e tempest-CreateVolumesFromImageTest-1479598366 None] Created volume successfully. Apr 24 13:58:49 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ad99c7-18cb-400f-a27f-f47af6130f2f]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:58:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-69aeb525-b44c-4a37-aa38-23c127d24f26 tempest-VolumeDependencyTests-1150031044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:49 devstack sudo[91081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c Apr 24 13:58:49 devstack sudo[91081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:50 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-fc6763fd-ed74-44ae-ac87-6cc107f5e32f tempest-CreateVolumesFromImageTest-1479598366 None] Acquiring lock "cinder-15808b6a-647e-4baa-a2a4-540b777b01b5-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:58:50 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-fc6763fd-ed74-44ae-ac87-6cc107f5e32f tempest-CreateVolumesFromImageTest-1479598366 None] Lock "cinder-15808b6a-647e-4baa-a2a4-540b777b01b5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:58:50 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-fc6763fd-ed74-44ae-ac87-6cc107f5e32f tempest-CreateVolumesFromImageTest-1479598366 None] Acquiring lock "cinder-quobyte-15808b6a-647e-4baa-a2a4-540b777b01b5" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:58:50 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-fc6763fd-ed74-44ae-ac87-6cc107f5e32f tempest-CreateVolumesFromImageTest-1479598366 None] Lock "cinder-quobyte-15808b6a-647e-4baa-a2a4-540b777b01b5" acquired by "delete_volume" :: waited 0.025s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:58:50 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[0500209c-6024-4f01-ba91-60bf5ecd62f4]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:58:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-fc6763fd-ed74-44ae-ac87-6cc107f5e32f tempest-CreateVolumesFromImageTest-1479598366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-15808b6a-647e-4baa-a2a4-540b777b01b5 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:50 devstack sudo[91089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-15808b6a-647e-4baa-a2a4-540b777b01b5 Apr 24 13:58:50 devstack sudo[91089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:50 devstack sudo[91081]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-69aeb525-b44c-4a37-aa38-23c127d24f26 tempest-VolumeDependencyTests-1150031044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c" returned: 0 in 0.802s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-69aeb525-b44c-4a37-aa38-23c127d24f26 tempest-VolumeDependencyTests-1150031044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c.39dca2e5-db0e-4e48-8dc3-d615ef6299a3 1G {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:50 devstack sudo[91094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c.39dca2e5-db0e-4e48-8dc3-d615ef6299a3 1G Apr 24 13:58:50 devstack sudo[91094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:50 devstack sudo[91089]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-fc6763fd-ed74-44ae-ac87-6cc107f5e32f tempest-CreateVolumesFromImageTest-1479598366 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-15808b6a-647e-4baa-a2a4-540b777b01b5" returned: 0 in 0.778s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-fc6763fd-ed74-44ae-ac87-6cc107f5e32f tempest-CreateVolumesFromImageTest-1479598366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-15808b6a-647e-4baa-a2a4-540b777b01b5 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:51 devstack sudo[91101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-15808b6a-647e-4baa-a2a4-540b777b01b5 Apr 24 13:58:51 devstack sudo[91101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:51 devstack sudo[91094]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-69aeb525-b44c-4a37-aa38-23c127d24f26 tempest-VolumeDependencyTests-1150031044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c.39dca2e5-db0e-4e48-8dc3-d615ef6299a3 1G" returned: 0 in 0.832s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-69aeb525-b44c-4a37-aa38-23c127d24f26 tempest-VolumeDependencyTests-1150031044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0cab67b-8220-4294-ae29-28e0541a9e5c -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c.39dca2e5-db0e-4e48-8dc3-d615ef6299a3 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:51 devstack sudo[91104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0cab67b-8220-4294-ae29-28e0541a9e5c -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c.39dca2e5-db0e-4e48-8dc3-d615ef6299a3 Apr 24 13:58:51 devstack sudo[91104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:51 devstack sudo[91101]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-fc6763fd-ed74-44ae-ac87-6cc107f5e32f tempest-CreateVolumesFromImageTest-1479598366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-15808b6a-647e-4baa-a2a4-540b777b01b5" returned: 0 in 0.828s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:51 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-fc6763fd-ed74-44ae-ac87-6cc107f5e32f tempest-CreateVolumesFromImageTest-1479598366 None] Lock "cinder-quobyte-15808b6a-647e-4baa-a2a4-540b777b01b5" released by "delete_volume" :: held 1.662s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:58:52 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-fc6763fd-ed74-44ae-ac87-6cc107f5e32f tempest-CreateVolumesFromImageTest-1479598366 None] Created reservations ['ef5dc93f-1d63-48b0-aece-c11e1c3cbaf1', 'c4b52b1d-cd8e-443d-960f-63d9cde3a418', '0a8aa8c3-565d-42aa-9f22-4de024e40ac0', '94a730e2-1b8c-4e3e-837b-8daf56b1337b'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:58:52 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-fc6763fd-ed74-44ae-ac87-6cc107f5e32f tempest-CreateVolumesFromImageTest-1479598366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:58:52 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-fc6763fd-ed74-44ae-ac87-6cc107f5e32f tempest-CreateVolumesFromImageTest-1479598366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:58:52 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-fc6763fd-ed74-44ae-ac87-6cc107f5e32f tempest-CreateVolumesFromImageTest-1479598366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:58:52 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-fc6763fd-ed74-44ae-ac87-6cc107f5e32f tempest-CreateVolumesFromImageTest-1479598366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:58:52 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-fc6763fd-ed74-44ae-ac87-6cc107f5e32f tempest-CreateVolumesFromImageTest-1479598366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:58:52 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-fc6763fd-ed74-44ae-ac87-6cc107f5e32f tempest-CreateVolumesFromImageTest-1479598366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:52 devstack sudo[91111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:58:52 devstack sudo[91111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:52 devstack sudo[91104]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:52 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-69aeb525-b44c-4a37-aa38-23c127d24f26 tempest-VolumeDependencyTests-1150031044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0cab67b-8220-4294-ae29-28e0541a9e5c -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c.39dca2e5-db0e-4e48-8dc3-d615ef6299a3" returned: 0 in 0.772s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:52 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-69aeb525-b44c-4a37-aa38-23c127d24f26 tempest-VolumeDependencyTests-1150031044 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c.39dca2e5-db0e-4e48-8dc3-d615ef6299a3 is being set with open permissions: ugo+rw Apr 24 13:58:52 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-69aeb525-b44c-4a37-aa38-23c127d24f26 tempest-VolumeDependencyTests-1150031044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c.39dca2e5-db0e-4e48-8dc3-d615ef6299a3 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:52 devstack sudo[91113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c.39dca2e5-db0e-4e48-8dc3-d615ef6299a3 Apr 24 13:58:52 devstack sudo[91113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:52 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-5f9edac6-e13b-4be8-95cd-9903546898ef tempest-CreateVolumesFromImageTest-1479598366 None] Acquiring lock "cinder-21e6dc20-548b-4f1e-bc48-3e4d08b00527-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:58:52 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-5f9edac6-e13b-4be8-95cd-9903546898ef tempest-CreateVolumesFromImageTest-1479598366 None] Lock "cinder-21e6dc20-548b-4f1e-bc48-3e4d08b00527-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:58:52 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-5f9edac6-e13b-4be8-95cd-9903546898ef tempest-CreateVolumesFromImageTest-1479598366 None] Acquiring lock "cinder-quobyte-21e6dc20-548b-4f1e-bc48-3e4d08b00527" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:58:52 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-5f9edac6-e13b-4be8-95cd-9903546898ef tempest-CreateVolumesFromImageTest-1479598366 None] Lock "cinder-quobyte-21e6dc20-548b-4f1e-bc48-3e4d08b00527" acquired by "delete_volume" :: waited 0.024s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:58:52 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[33161e02-bde9-4217-9e7b-db186dd19beb]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:58:52 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5f9edac6-e13b-4be8-95cd-9903546898ef tempest-CreateVolumesFromImageTest-1479598366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-21e6dc20-548b-4f1e-bc48-3e4d08b00527 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:52 devstack sudo[91111]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:52 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-fc6763fd-ed74-44ae-ac87-6cc107f5e32f tempest-CreateVolumesFromImageTest-1479598366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.581s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:52 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-fc6763fd-ed74-44ae-ac87-6cc107f5e32f tempest-CreateVolumesFromImageTest-1479598366 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:58:52 devstack sudo[91116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-21e6dc20-548b-4f1e-bc48-3e4d08b00527 Apr 24 13:58:52 devstack sudo[91116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:52 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-fc6763fd-ed74-44ae-ac87-6cc107f5e32f tempest-CreateVolumesFromImageTest-1479598366 None] Deleted volume successfully. Apr 24 13:58:52 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-fc6763fd-ed74-44ae-ac87-6cc107f5e32f tempest-CreateVolumesFromImageTest-1479598366 None] Lock "cinder-15808b6a-647e-4baa-a2a4-540b777b01b5-delete_volume" released by "delete_volume" :: held 2.630s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:58:52 devstack sudo[91113]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:52 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-69aeb525-b44c-4a37-aa38-23c127d24f26 tempest-VolumeDependencyTests-1150031044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c.39dca2e5-db0e-4e48-8dc3-d615ef6299a3" returned: 0 in 0.655s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:52 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-69aeb525-b44c-4a37-aa38-23c127d24f26 tempest-VolumeDependencyTests-1150031044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:52 devstack sudo[91119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c.info Apr 24 13:58:52 devstack sudo[91119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:53 devstack sudo[91116]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5f9edac6-e13b-4be8-95cd-9903546898ef tempest-CreateVolumesFromImageTest-1479598366 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-21e6dc20-548b-4f1e-bc48-3e4d08b00527" returned: 0 in 0.754s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5f9edac6-e13b-4be8-95cd-9903546898ef tempest-CreateVolumesFromImageTest-1479598366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-21e6dc20-548b-4f1e-bc48-3e4d08b00527 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:53 devstack sudo[91125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-21e6dc20-548b-4f1e-bc48-3e4d08b00527 Apr 24 13:58:53 devstack sudo[91125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:53 devstack sudo[91119]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-69aeb525-b44c-4a37-aa38-23c127d24f26 tempest-VolumeDependencyTests-1150031044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c.info" returned: 0 in 0.574s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:53 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-69aeb525-b44c-4a37-aa38-23c127d24f26 tempest-VolumeDependencyTests-1150031044 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c.info is being set with open permissions: ugo+rw Apr 24 13:58:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-69aeb525-b44c-4a37-aa38-23c127d24f26 tempest-VolumeDependencyTests-1150031044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:53 devstack sudo[91127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c.info Apr 24 13:58:53 devstack sudo[91127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:53 devstack sudo[91127]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-69aeb525-b44c-4a37-aa38-23c127d24f26 tempest-VolumeDependencyTests-1150031044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c.info" returned: 0 in 0.545s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-69aeb525-b44c-4a37-aa38-23c127d24f26 tempest-VolumeDependencyTests-1150031044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.341s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:58:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-bb552482-3c3e-4e92-885b-329fa337a055 tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.504s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:58:54 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-bb552482-3c3e-4e92-885b-329fa337a055 tempest-CreateVolumesFromSnapshotTest-323228305 None] Creating offline snapshot 45960c6c-f299-4951-aeab-2d24fb7ff575 of volume 9c080eba-eeeb-4d7a-a592-a419809b3b8c {{(pid=82046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 13:58:54 devstack sudo[91125]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:54 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5f9edac6-e13b-4be8-95cd-9903546898ef tempest-CreateVolumesFromImageTest-1479598366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-21e6dc20-548b-4f1e-bc48-3e4d08b00527" returned: 0 in 0.696s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:54 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[044601a6-c938-46ad-abbd-882d297ca4d9]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:58:54 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bb552482-3c3e-4e92-885b-329fa337a055 tempest-CreateVolumesFromSnapshotTest-323228305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:54 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-69aeb525-b44c-4a37-aa38-23c127d24f26 tempest-VolumeDependencyTests-1150031044 None] Create snapshot completed successfully Apr 24 13:58:54 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-5f9edac6-e13b-4be8-95cd-9903546898ef tempest-CreateVolumesFromImageTest-1479598366 None] Lock "cinder-quobyte-21e6dc20-548b-4f1e-bc48-3e4d08b00527" released by "delete_volume" :: held 1.552s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:58:54 devstack sudo[91131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c Apr 24 13:58:54 devstack sudo[91131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:54 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-5f9edac6-e13b-4be8-95cd-9903546898ef tempest-CreateVolumesFromImageTest-1479598366 None] Created reservations ['b8faccdb-bf85-476b-8347-08749d4bee87', 'd9c10fe0-198b-43da-aadb-4e1d698dcb54', '408c0e0a-959b-481a-9332-50e6cbad18c8', 'c34018e7-15ea-4383-a27e-4bfe24ea1f5d'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:58:54 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5f9edac6-e13b-4be8-95cd-9903546898ef tempest-CreateVolumesFromImageTest-1479598366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:58:54 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5f9edac6-e13b-4be8-95cd-9903546898ef tempest-CreateVolumesFromImageTest-1479598366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:58:54 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-5f9edac6-e13b-4be8-95cd-9903546898ef tempest-CreateVolumesFromImageTest-1479598366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:58:54 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-5f9edac6-e13b-4be8-95cd-9903546898ef tempest-CreateVolumesFromImageTest-1479598366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:58:54 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5f9edac6-e13b-4be8-95cd-9903546898ef tempest-CreateVolumesFromImageTest-1479598366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:58:54 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5f9edac6-e13b-4be8-95cd-9903546898ef tempest-CreateVolumesFromImageTest-1479598366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:54 devstack sudo[91133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:58:54 devstack sudo[91133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:54 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b868a0ce-f6b8-4ac9-bea9-cc4c4bb9c9c9 tempest-CreateVolumesFromImageTest-1479598366 None] Acquiring lock "cinder-c4398cf2-e075-4408-b57a-9821753c9725-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:58:54 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b868a0ce-f6b8-4ac9-bea9-cc4c4bb9c9c9 tempest-CreateVolumesFromImageTest-1479598366 None] Lock "cinder-c4398cf2-e075-4408-b57a-9821753c9725-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:58:54 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:58:54 devstack sudo[91131]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:54 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] Flow 'volume_create_manager' (09ffdffe-f390-4e60-8928-159043c67dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:58:54 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44f63221-3905-4e8f-9eb8-7ee8f36973f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:54 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bb552482-3c3e-4e92-885b-329fa337a055 tempest-CreateVolumesFromSnapshotTest-323228305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c" returned: 0 in 0.943s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:54 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bb552482-3c3e-4e92-885b-329fa337a055 tempest-CreateVolumesFromSnapshotTest-323228305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c.45960c6c-f299-4951-aeab-2d24fb7ff575 1G {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:55 devstack sudo[91138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c.45960c6c-f299-4951-aeab-2d24fb7ff575 1G Apr 24 13:58:55 devstack sudo[91138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:55 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b868a0ce-f6b8-4ac9-bea9-cc4c4bb9c9c9 tempest-CreateVolumesFromImageTest-1479598366 None] Acquiring lock "cinder-quobyte-c4398cf2-e075-4408-b57a-9821753c9725" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:58:55 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44f63221-3905-4e8f-9eb8-7ee8f36973f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:58:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-607813677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d68173d1-3ad0-46c2-9752-7cc2887b847d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f005df8063f146e6a7771f312188d27b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=39dca2e5-db0e-4e48-8dc3-d615ef6299a3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:58:55Z,use_quota=True,user_id='f8c84f24edbc491cab1205885eab34d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:55 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61abf01e-4477-4ec2-98b0-27802b7ea9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:55 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61abf01e-4477-4ec2-98b0-27802b7ea9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:55 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92f0dc4a-be12-4ec4-9a77-9782d31371b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:55 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92f0dc4a-be12-4ec4-9a77-9782d31371b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd68173d1-3ad0-46c2-9752-7cc2887b847d', 'volume_name': 'volume-d68173d1-3ad0-46c2-9752-7cc2887b847d', 'volume_size': 1, 'snapshot_id': '39dca2e5-db0e-4e48-8dc3-d615ef6299a3'}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:55 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f580840e-28a0-4aef-a9f3-6660e52b57ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:55 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f580840e-28a0-4aef-a9f3-6660e52b57ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:55 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7ed71f0-0b84-485a-9605-7dae3fd4e883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:55 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] Volume d68173d1-3ad0-46c2-9752-7cc2887b847d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d68173d1-3ad0-46c2-9752-7cc2887b847d', 'volume_size': 1, 'snapshot_id': '39dca2e5-db0e-4e48-8dc3-d615ef6299a3'} Apr 24 13:58:55 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:58:55 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b868a0ce-f6b8-4ac9-bea9-cc4c4bb9c9c9 tempest-CreateVolumesFromImageTest-1479598366 None] Lock "cinder-quobyte-c4398cf2-e075-4408-b57a-9821753c9725" acquired by "delete_volume" :: waited 0.089s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:58:55 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9adcad-53d1-45b8-9018-e96b9058c13b]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:58:55 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b868a0ce-f6b8-4ac9-bea9-cc4c4bb9c9c9 tempest-CreateVolumesFromImageTest-1479598366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c4398cf2-e075-4408-b57a-9821753c9725 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:55 devstack sudo[91133]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:55 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5f9edac6-e13b-4be8-95cd-9903546898ef tempest-CreateVolumesFromImageTest-1479598366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.916s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:55 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-5f9edac6-e13b-4be8-95cd-9903546898ef tempest-CreateVolumesFromImageTest-1479598366 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:58:55 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-5f9edac6-e13b-4be8-95cd-9903546898ef tempest-CreateVolumesFromImageTest-1479598366 None] Deleted volume successfully. Apr 24 13:58:55 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-5f9edac6-e13b-4be8-95cd-9903546898ef tempest-CreateVolumesFromImageTest-1479598366 None] Lock "cinder-21e6dc20-548b-4f1e-bc48-3e4d08b00527-delete_volume" released by "delete_volume" :: held 2.758s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:58:55 devstack sudo[91141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c4398cf2-e075-4408-b57a-9821753c9725 Apr 24 13:58:55 devstack sudo[91141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:55 devstack sudo[91138]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:55 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bb552482-3c3e-4e92-885b-329fa337a055 tempest-CreateVolumesFromSnapshotTest-323228305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c.45960c6c-f299-4951-aeab-2d24fb7ff575 1G" returned: 0 in 0.771s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:55 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bb552482-3c3e-4e92-885b-329fa337a055 tempest-CreateVolumesFromSnapshotTest-323228305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c.45960c6c-f299-4951-aeab-2d24fb7ff575 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:55 devstack sudo[91141]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:55 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b868a0ce-f6b8-4ac9-bea9-cc4c4bb9c9c9 tempest-CreateVolumesFromImageTest-1479598366 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c4398cf2-e075-4408-b57a-9821753c9725" returned: 0 in 0.650s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:55 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b868a0ce-f6b8-4ac9-bea9-cc4c4bb9c9c9 tempest-CreateVolumesFromImageTest-1479598366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c4398cf2-e075-4408-b57a-9821753c9725 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:55 devstack sudo[91150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c.45960c6c-f299-4951-aeab-2d24fb7ff575 Apr 24 13:58:55 devstack sudo[91150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:55 devstack sudo[91151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c4398cf2-e075-4408-b57a-9821753c9725 Apr 24 13:58:55 devstack sudo[91151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:56 devstack sudo[91151]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:56 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b868a0ce-f6b8-4ac9-bea9-cc4c4bb9c9c9 tempest-CreateVolumesFromImageTest-1479598366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c4398cf2-e075-4408-b57a-9821753c9725" returned: 0 in 0.677s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:56 devstack sudo[91150]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:56 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b868a0ce-f6b8-4ac9-bea9-cc4c4bb9c9c9 tempest-CreateVolumesFromImageTest-1479598366 None] Lock "cinder-quobyte-c4398cf2-e075-4408-b57a-9821753c9725" released by "delete_volume" :: held 1.382s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:58:56 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bb552482-3c3e-4e92-885b-329fa337a055 tempest-CreateVolumesFromSnapshotTest-323228305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c.45960c6c-f299-4951-aeab-2d24fb7ff575" returned: 0 in 0.745s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:56 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-bb552482-3c3e-4e92-885b-329fa337a055 tempest-CreateVolumesFromSnapshotTest-323228305 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c.45960c6c-f299-4951-aeab-2d24fb7ff575 is being set with open permissions: ugo+rw Apr 24 13:58:56 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bb552482-3c3e-4e92-885b-329fa337a055 tempest-CreateVolumesFromSnapshotTest-323228305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c.45960c6c-f299-4951-aeab-2d24fb7ff575 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:56 devstack sudo[91158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c.45960c6c-f299-4951-aeab-2d24fb7ff575 Apr 24 13:58:56 devstack sudo[91158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:56 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-b868a0ce-f6b8-4ac9-bea9-cc4c4bb9c9c9 tempest-CreateVolumesFromImageTest-1479598366 None] Created reservations ['85734420-7a1d-4e79-a24d-f5fabdfdd9a8', 'a3f1486a-3bc8-4cd3-88d1-2c1f79feeb5e', 'ce2ffd9f-651e-4467-b9dc-7565b3cbb280', '10c6c34f-f996-4b8e-a135-0a009e6bdfd7'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:58:56 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b868a0ce-f6b8-4ac9-bea9-cc4c4bb9c9c9 tempest-CreateVolumesFromImageTest-1479598366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:58:56 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b868a0ce-f6b8-4ac9-bea9-cc4c4bb9c9c9 tempest-CreateVolumesFromImageTest-1479598366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:58:56 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b868a0ce-f6b8-4ac9-bea9-cc4c4bb9c9c9 tempest-CreateVolumesFromImageTest-1479598366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:58:56 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b868a0ce-f6b8-4ac9-bea9-cc4c4bb9c9c9 tempest-CreateVolumesFromImageTest-1479598366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:58:56 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b868a0ce-f6b8-4ac9-bea9-cc4c4bb9c9c9 tempest-CreateVolumesFromImageTest-1479598366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:58:56 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b868a0ce-f6b8-4ac9-bea9-cc4c4bb9c9c9 tempest-CreateVolumesFromImageTest-1479598366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:56 devstack sudo[91160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:58:56 devstack sudo[91160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:57 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e83e1b0a-a782-4f83-9b4a-e0ddad46994e tempest-CreateVolumesFromImageTest-1479598366 None] Acquiring lock "cinder-db715aa0-d6ca-4e44-8e72-8ebc212c87ea-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:58:57 devstack sudo[91158]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:57 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e83e1b0a-a782-4f83-9b4a-e0ddad46994e tempest-CreateVolumesFromImageTest-1479598366 None] Lock "cinder-db715aa0-d6ca-4e44-8e72-8ebc212c87ea-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:58:57 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bb552482-3c3e-4e92-885b-329fa337a055 tempest-CreateVolumesFromSnapshotTest-323228305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c.45960c6c-f299-4951-aeab-2d24fb7ff575" returned: 0 in 0.763s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:57 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e83e1b0a-a782-4f83-9b4a-e0ddad46994e tempest-CreateVolumesFromImageTest-1479598366 None] Acquiring lock "cinder-quobyte-db715aa0-d6ca-4e44-8e72-8ebc212c87ea" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:58:57 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bb552482-3c3e-4e92-885b-329fa337a055 tempest-CreateVolumesFromSnapshotTest-323228305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:57 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e83e1b0a-a782-4f83-9b4a-e0ddad46994e tempest-CreateVolumesFromImageTest-1479598366 None] Lock "cinder-quobyte-db715aa0-d6ca-4e44-8e72-8ebc212c87ea" acquired by "delete_volume" :: waited 0.047s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:58:57 devstack sudo[91160]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:57 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b868a0ce-f6b8-4ac9-bea9-cc4c4bb9c9c9 tempest-CreateVolumesFromImageTest-1479598366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.622s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:57 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-b868a0ce-f6b8-4ac9-bea9-cc4c4bb9c9c9 tempest-CreateVolumesFromImageTest-1479598366 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:58:57 devstack sudo[91164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c.info Apr 24 13:58:57 devstack sudo[91164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:57 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-b868a0ce-f6b8-4ac9-bea9-cc4c4bb9c9c9 tempest-CreateVolumesFromImageTest-1479598366 None] Deleted volume successfully. Apr 24 13:58:57 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[97cf2ede-d775-4531-8cb5-6109993e869a]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:58:57 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e83e1b0a-a782-4f83-9b4a-e0ddad46994e tempest-CreateVolumesFromImageTest-1479598366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-db715aa0-d6ca-4e44-8e72-8ebc212c87ea {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:57 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b868a0ce-f6b8-4ac9-bea9-cc4c4bb9c9c9 tempest-CreateVolumesFromImageTest-1479598366 None] Lock "cinder-c4398cf2-e075-4408-b57a-9821753c9725-delete_volume" released by "delete_volume" :: held 2.562s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:58:57 devstack sudo[91166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-db715aa0-d6ca-4e44-8e72-8ebc212c87ea Apr 24 13:58:57 devstack sudo[91166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:58 devstack sudo[91164]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bb552482-3c3e-4e92-885b-329fa337a055 tempest-CreateVolumesFromSnapshotTest-323228305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c.info" returned: 0 in 0.712s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:58 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-bb552482-3c3e-4e92-885b-329fa337a055 tempest-CreateVolumesFromSnapshotTest-323228305 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c.info is being set with open permissions: ugo+rw Apr 24 13:58:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bb552482-3c3e-4e92-885b-329fa337a055 tempest-CreateVolumesFromSnapshotTest-323228305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:58 devstack sudo[91171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c.info Apr 24 13:58:58 devstack sudo[91171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:58 devstack sudo[91166]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e83e1b0a-a782-4f83-9b4a-e0ddad46994e tempest-CreateVolumesFromImageTest-1479598366 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-db715aa0-d6ca-4e44-8e72-8ebc212c87ea" returned: 0 in 0.793s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e83e1b0a-a782-4f83-9b4a-e0ddad46994e tempest-CreateVolumesFromImageTest-1479598366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-db715aa0-d6ca-4e44-8e72-8ebc212c87ea {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:58 devstack sudo[91174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-db715aa0-d6ca-4e44-8e72-8ebc212c87ea Apr 24 13:58:58 devstack sudo[91174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:58 devstack sudo[91171]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-bb552482-3c3e-4e92-885b-329fa337a055 tempest-CreateVolumesFromSnapshotTest-323228305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c.info" returned: 0 in 0.745s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-bb552482-3c3e-4e92-885b-329fa337a055 tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.854s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:58:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.734s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:58:58 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] Acquiring lock "cinder-quobyte-39dca2e5-db0e-4e48-8dc3-d615ef6299a3-d68173d1-3ad0-46c2-9752-7cc2887b847d" by "_create_volume_from_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:58:58 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] Lock "cinder-quobyte-39dca2e5-db0e-4e48-8dc3-d615ef6299a3-d68173d1-3ad0-46c2-9752-7cc2887b847d" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:58:58 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] Creating volume d68173d1-3ad0-46c2-9752-7cc2887b847d from snapshot 39dca2e5-db0e-4e48-8dc3-d615ef6299a3 {{(pid=82046) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 13:58:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:58:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:58:58 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:58:58 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:58:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:58:58 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:58:58 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] Acquiring lock "cinder-quobyte-d68173d1-3ad0-46c2-9752-7cc2887b847d" by "_copy_volume_from_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:58:58 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-bb552482-3c3e-4e92-885b-329fa337a055 tempest-CreateVolumesFromSnapshotTest-323228305 None] Create snapshot completed successfully Apr 24 13:58:58 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] Lock "cinder-quobyte-d68173d1-3ad0-46c2-9752-7cc2887b847d" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:58:58 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] snapshot: 39dca2e5-db0e-4e48-8dc3-d615ef6299a3, volume: d68173d1-3ad0-46c2-9752-7cc2887b847d, {{(pid=82046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 13:58:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:58:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:58:58 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:58:58 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:58:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:58:58 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[1afbeb20-cab3-492f-b25a-e34e8cec9b85]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:58:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c.39dca2e5-db0e-4e48-8dc3-d615ef6299a3 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:59 devstack sudo[91174]: pam_unix(sudo:session): session closed for user root Apr 24 13:58:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e83e1b0a-a782-4f83-9b4a-e0ddad46994e tempest-CreateVolumesFromImageTest-1479598366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-db715aa0-d6ca-4e44-8e72-8ebc212c87ea" returned: 0 in 0.814s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:58:59 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e83e1b0a-a782-4f83-9b4a-e0ddad46994e tempest-CreateVolumesFromImageTest-1479598366 None] Lock "cinder-quobyte-db715aa0-d6ca-4e44-8e72-8ebc212c87ea" released by "delete_volume" :: held 1.664s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:58:59 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-e83e1b0a-a782-4f83-9b4a-e0ddad46994e tempest-CreateVolumesFromImageTest-1479598366 None] Created reservations ['798267a3-d21c-4602-a810-deb0f2539966', 'cd350777-06cd-4fc6-aedc-ed37a18f9408', 'deb6d16c-17f7-499f-af86-6f20b848bff3', 'fb776cbd-c9fe-4925-bb8b-15b8671e4519'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:58:59 devstack sudo[91178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c.39dca2e5-db0e-4e48-8dc3-d615ef6299a3 Apr 24 13:58:59 devstack sudo[91178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-e83e1b0a-a782-4f83-9b4a-e0ddad46994e tempest-CreateVolumesFromImageTest-1479598366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:58:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-e83e1b0a-a782-4f83-9b4a-e0ddad46994e tempest-CreateVolumesFromImageTest-1479598366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:58:59 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-e83e1b0a-a782-4f83-9b4a-e0ddad46994e tempest-CreateVolumesFromImageTest-1479598366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:58:59 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-e83e1b0a-a782-4f83-9b4a-e0ddad46994e tempest-CreateVolumesFromImageTest-1479598366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:58:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-e83e1b0a-a782-4f83-9b4a-e0ddad46994e tempest-CreateVolumesFromImageTest-1479598366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:58:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e83e1b0a-a782-4f83-9b4a-e0ddad46994e tempest-CreateVolumesFromImageTest-1479598366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:59 devstack sudo[91180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:58:59 devstack sudo[91180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:59 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-053d0d8a-4383-44bf-b62e-c5facf6e25b8 tempest-CreateVolumesFromImageTest-1479598366 None] Acquiring lock "cinder-30f97cb0-acda-4947-9ab9-0154da5bc324-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:58:59 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-053d0d8a-4383-44bf-b62e-c5facf6e25b8 tempest-CreateVolumesFromImageTest-1479598366 None] Lock "cinder-30f97cb0-acda-4947-9ab9-0154da5bc324-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:58:59 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-053d0d8a-4383-44bf-b62e-c5facf6e25b8 tempest-CreateVolumesFromImageTest-1479598366 None] Acquiring lock "cinder-quobyte-30f97cb0-acda-4947-9ab9-0154da5bc324" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:58:59 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-053d0d8a-4383-44bf-b62e-c5facf6e25b8 tempest-CreateVolumesFromImageTest-1479598366 None] Lock "cinder-quobyte-30f97cb0-acda-4947-9ab9-0154da5bc324" acquired by "delete_volume" :: waited 0.020s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:58:59 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[f622ce06-8afa-406d-ae7e-627b0e749666]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:58:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-053d0d8a-4383-44bf-b62e-c5facf6e25b8 tempest-CreateVolumesFromImageTest-1479598366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30f97cb0-acda-4947-9ab9-0154da5bc324 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:58:59 devstack sudo[91182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30f97cb0-acda-4947-9ab9-0154da5bc324 Apr 24 13:58:59 devstack sudo[91182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:58:59 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-b36a1cf1-7132-4e0a-9b98-42dbf8fe0d02 tempest-CreateVolumesFromSnapshotTest-323228305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:58:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b36a1cf1-7132-4e0a-9b98-42dbf8fe0d02 tempest-CreateVolumesFromSnapshotTest-323228305 None] Flow 'volume_create_manager' (f13195b7-b504-43ca-b8a9-44f6adcc2e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:58:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b36a1cf1-7132-4e0a-9b98-42dbf8fe0d02 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36f6b243-bdf5-406f-9f22-44a4c148e829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b36a1cf1-7132-4e0a-9b98-42dbf8fe0d02 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36f6b243-bdf5-406f-9f22-44a4c148e829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-530173595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e6444cb-a300-460e-8cfe-0e1cac3bb5ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b343905d55542e5975ceeb4e7db62b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:59:00Z,use_quota=True,user_id='a9d93529cca74aeeb26c17800ea796b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:58:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b36a1cf1-7132-4e0a-9b98-42dbf8fe0d02 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98ab51de-4e87-47ce-bc90-9deadbe1821f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:58:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b36a1cf1-7132-4e0a-9b98-42dbf8fe0d02 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98ab51de-4e87-47ce-bc90-9deadbe1821f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:00 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b36a1cf1-7132-4e0a-9b98-42dbf8fe0d02 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ecba67e-1db6-4ee1-881b-8dba0464eb79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:00 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b36a1cf1-7132-4e0a-9b98-42dbf8fe0d02 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ecba67e-1db6-4ee1-881b-8dba0464eb79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e6444cb-a300-460e-8cfe-0e1cac3bb5ca', 'volume_name': 'volume-8e6444cb-a300-460e-8cfe-0e1cac3bb5ca', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:00 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b36a1cf1-7132-4e0a-9b98-42dbf8fe0d02 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c4759d5-6144-4dd4-88fa-cb40a9ee5d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:00 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b36a1cf1-7132-4e0a-9b98-42dbf8fe0d02 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c4759d5-6144-4dd4-88fa-cb40a9ee5d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:00 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b36a1cf1-7132-4e0a-9b98-42dbf8fe0d02 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e98bb72f-4d4f-4913-9a02-b7bc7a2ab602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:00 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-b36a1cf1-7132-4e0a-9b98-42dbf8fe0d02 tempest-CreateVolumesFromSnapshotTest-323228305 None] Volume 8e6444cb-a300-460e-8cfe-0e1cac3bb5ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e6444cb-a300-460e-8cfe-0e1cac3bb5ca', 'volume_size': 1} Apr 24 13:59:00 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b36a1cf1-7132-4e0a-9b98-42dbf8fe0d02 tempest-CreateVolumesFromSnapshotTest-323228305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:59:00 devstack sudo[91178]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:00 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c.39dca2e5-db0e-4e48-8dc3-d615ef6299a3" returned: 0 in 1.126s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:00 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0cab67b-8220-4294-ae29-28e0541a9e5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:59:00 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c {{(pid=82046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 13:59:00 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] Creating direct copy from snapshot {{(pid=82046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 13:59:00 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9ce290-5bff-4536-998c-1195fa1c2286]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:59:00 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:00 devstack sudo[91188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c Apr 24 13:59:00 devstack sudo[91188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:00 devstack sudo[91180]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:00 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e83e1b0a-a782-4f83-9b4a-e0ddad46994e tempest-CreateVolumesFromImageTest-1479598366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 1.128s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:00 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-e83e1b0a-a782-4f83-9b4a-e0ddad46994e tempest-CreateVolumesFromImageTest-1479598366 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:59:00 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-50ed8f2f-2a77-4681-aa55-079369469a29 tempest-CreateVolumesFromSnapshotTest-323228305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:59:00 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-50ed8f2f-2a77-4681-aa55-079369469a29 tempest-CreateVolumesFromSnapshotTest-323228305 None] Flow 'volume_create_manager' (c266ab32-b039-4b9c-8c5e-3fe4826281f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:59:00 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-50ed8f2f-2a77-4681-aa55-079369469a29 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4034b8eb-c920-4aa1-9131-1cba147b8526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:00 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-e83e1b0a-a782-4f83-9b4a-e0ddad46994e tempest-CreateVolumesFromImageTest-1479598366 None] Deleted volume successfully. Apr 24 13:59:00 devstack cinder-volume[82046]: DEBUG dbcounter [-] [82046] Writing DB stats cinder:UPDATE=111,cinder:INSERT=26,cinder:DELETE=12,cinder:SELECT=88 {{(pid=82046) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 13:59:00 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-50ed8f2f-2a77-4681-aa55-079369469a29 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4034b8eb-c920-4aa1-9131-1cba147b8526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-918170834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db9096a6-e914-4b96-87e3-9271d466c3ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b343905d55542e5975ceeb4e7db62b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:59:00Z,use_quota=True,user_id='a9d93529cca74aeeb26c17800ea796b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:00 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-50ed8f2f-2a77-4681-aa55-079369469a29 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55eb91fe-4369-4de3-84d6-99ea7444315f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:00 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-50ed8f2f-2a77-4681-aa55-079369469a29 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55eb91fe-4369-4de3-84d6-99ea7444315f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:00 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-50ed8f2f-2a77-4681-aa55-079369469a29 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8faac24-404e-40fc-b178-f953968f8008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:00 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-50ed8f2f-2a77-4681-aa55-079369469a29 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8faac24-404e-40fc-b178-f953968f8008) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db9096a6-e914-4b96-87e3-9271d466c3ad', 'volume_name': 'volume-db9096a6-e914-4b96-87e3-9271d466c3ad', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:00 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-50ed8f2f-2a77-4681-aa55-079369469a29 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e28cbbe-3554-48d6-b406-4cb1cf18f704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:00 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-50ed8f2f-2a77-4681-aa55-079369469a29 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e28cbbe-3554-48d6-b406-4cb1cf18f704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:00 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-50ed8f2f-2a77-4681-aa55-079369469a29 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23d18ec9-b98e-4a93-b6f1-0e6a6511eccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:00 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-50ed8f2f-2a77-4681-aa55-079369469a29 tempest-CreateVolumesFromSnapshotTest-323228305 None] Volume db9096a6-e914-4b96-87e3-9271d466c3ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db9096a6-e914-4b96-87e3-9271d466c3ad', 'volume_size': 1} Apr 24 13:59:00 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-50ed8f2f-2a77-4681-aa55-079369469a29 tempest-CreateVolumesFromSnapshotTest-323228305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:59:00 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e83e1b0a-a782-4f83-9b4a-e0ddad46994e tempest-CreateVolumesFromImageTest-1479598366 None] Lock "cinder-db715aa0-d6ca-4e44-8e72-8ebc212c87ea-delete_volume" released by "delete_volume" :: held 3.303s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:59:00 devstack sudo[91182]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:00 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-053d0d8a-4383-44bf-b62e-c5facf6e25b8 tempest-CreateVolumesFromImageTest-1479598366 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30f97cb0-acda-4947-9ab9-0154da5bc324" returned: 0 in 0.901s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:00 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-053d0d8a-4383-44bf-b62e-c5facf6e25b8 tempest-CreateVolumesFromImageTest-1479598366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30f97cb0-acda-4947-9ab9-0154da5bc324 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:00 devstack sudo[91193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30f97cb0-acda-4947-9ab9-0154da5bc324 Apr 24 13:59:00 devstack sudo[91193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:00 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-a61d3a21-fe97-481d-90fa-e71cb7f78b10 tempest-CreateVolumesFromSnapshotTest-323228305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:59:00 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a61d3a21-fe97-481d-90fa-e71cb7f78b10 tempest-CreateVolumesFromSnapshotTest-323228305 None] Flow 'volume_create_manager' (f1f5b2cf-e38f-497e-9eaa-714d803bbc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:59:00 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a61d3a21-fe97-481d-90fa-e71cb7f78b10 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26b7d049-dd3d-47b5-bd7b-defd77eca7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:01 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a61d3a21-fe97-481d-90fa-e71cb7f78b10 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26b7d049-dd3d-47b5-bd7b-defd77eca7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-39064707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9254918-44ae-4b5a-ab69-0a9ef551f0f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b343905d55542e5975ceeb4e7db62b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:59:01Z,use_quota=True,user_id='a9d93529cca74aeeb26c17800ea796b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:01 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a61d3a21-fe97-481d-90fa-e71cb7f78b10 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d05ebd4-b464-4f2f-8ea7-be6174f137d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:01 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a61d3a21-fe97-481d-90fa-e71cb7f78b10 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d05ebd4-b464-4f2f-8ea7-be6174f137d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:01 devstack sudo[91188]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:01 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a61d3a21-fe97-481d-90fa-e71cb7f78b10 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2db1be54-e485-468c-9fa9-56db726f31d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:01 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a61d3a21-fe97-481d-90fa-e71cb7f78b10 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2db1be54-e485-468c-9fa9-56db726f31d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9254918-44ae-4b5a-ab69-0a9ef551f0f0', 'volume_name': 'volume-a9254918-44ae-4b5a-ab69-0a9ef551f0f0', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:01 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a61d3a21-fe97-481d-90fa-e71cb7f78b10 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f67feaf7-959b-4a72-a53c-5b0028c230f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:01 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a61d3a21-fe97-481d-90fa-e71cb7f78b10 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f67feaf7-959b-4a72-a53c-5b0028c230f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:01 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a61d3a21-fe97-481d-90fa-e71cb7f78b10 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba861d3c-4426-4108-be8a-e76235e3aff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:01 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-a61d3a21-fe97-481d-90fa-e71cb7f78b10 tempest-CreateVolumesFromSnapshotTest-323228305 None] Volume a9254918-44ae-4b5a-ab69-0a9ef551f0f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9254918-44ae-4b5a-ab69-0a9ef551f0f0', 'volume_size': 1} Apr 24 13:59:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a61d3a21-fe97-481d-90fa-e71cb7f78b10 tempest-CreateVolumesFromSnapshotTest-323228305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:59:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c" returned: 0 in 0.997s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:01 devstack cinder-volume[82046]: DEBUG cinder.utils [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] Path /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d68173d1-3ad0-46c2-9752-7cc2887b847d not found in is_blk_device check {{(pid=82046) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 13:59:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d68173d1-3ad0-46c2-9752-7cc2887b847d {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:01 devstack sudo[91198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d68173d1-3ad0-46c2-9752-7cc2887b847d Apr 24 13:59:01 devstack sudo[91198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:01 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-debbcbd9-20d7-40f4-b08f-735e97496d89 tempest-CreateVolumesFromSnapshotTest-323228305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:59:01 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-debbcbd9-20d7-40f4-b08f-735e97496d89 tempest-CreateVolumesFromSnapshotTest-323228305 None] Flow 'volume_create_manager' (897f1ace-b044-4ad1-8f72-c7b3d28d616b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:59:01 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-debbcbd9-20d7-40f4-b08f-735e97496d89 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc406d76-4618-46ba-92cb-5af1866a9a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:01 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-debbcbd9-20d7-40f4-b08f-735e97496d89 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc406d76-4618-46ba-92cb-5af1866a9a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-66539908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=589112d4-be7e-4f53-9218-65c0dfbc1ec1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b343905d55542e5975ceeb4e7db62b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:59:01Z,use_quota=True,user_id='a9d93529cca74aeeb26c17800ea796b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:01 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-debbcbd9-20d7-40f4-b08f-735e97496d89 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74bdb664-3b86-4938-8e91-2c36f20c091b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:01 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-debbcbd9-20d7-40f4-b08f-735e97496d89 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74bdb664-3b86-4938-8e91-2c36f20c091b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:01 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-debbcbd9-20d7-40f4-b08f-735e97496d89 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94041a40-b930-47da-bbd7-7b518d1c042a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:01 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-debbcbd9-20d7-40f4-b08f-735e97496d89 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94041a40-b930-47da-bbd7-7b518d1c042a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '589112d4-be7e-4f53-9218-65c0dfbc1ec1', 'volume_name': 'volume-589112d4-be7e-4f53-9218-65c0dfbc1ec1', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:01 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-debbcbd9-20d7-40f4-b08f-735e97496d89 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (134e18e4-fbe1-419f-a548-9391b4901bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:01 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-debbcbd9-20d7-40f4-b08f-735e97496d89 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (134e18e4-fbe1-419f-a548-9391b4901bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:01 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-debbcbd9-20d7-40f4-b08f-735e97496d89 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4a1deb6-0c62-4314-916d-64a5661a4923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:01 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-debbcbd9-20d7-40f4-b08f-735e97496d89 tempest-CreateVolumesFromSnapshotTest-323228305 None] Volume 589112d4-be7e-4f53-9218-65c0dfbc1ec1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-589112d4-be7e-4f53-9218-65c0dfbc1ec1', 'volume_size': 1} Apr 24 13:59:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-debbcbd9-20d7-40f4-b08f-735e97496d89 tempest-CreateVolumesFromSnapshotTest-323228305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:59:01 devstack sudo[91193]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-053d0d8a-4383-44bf-b62e-c5facf6e25b8 tempest-CreateVolumesFromImageTest-1479598366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-30f97cb0-acda-4947-9ab9-0154da5bc324" returned: 0 in 1.025s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:01 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-053d0d8a-4383-44bf-b62e-c5facf6e25b8 tempest-CreateVolumesFromImageTest-1479598366 None] Lock "cinder-quobyte-30f97cb0-acda-4947-9ab9-0154da5bc324" released by "delete_volume" :: held 1.996s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:59:01 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-053d0d8a-4383-44bf-b62e-c5facf6e25b8 tempest-CreateVolumesFromImageTest-1479598366 None] Created reservations ['daaea699-5b3c-4daa-95b8-767ff80d9734', 'f679c860-3ebe-458a-ab25-e33cb12370cc', '073ef201-81fe-4c3d-8d92-42bc3809ed9e', 'de7ab0d4-5f7d-4b7f-8b0f-a6d4f60df2cb'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:59:01 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-46cf33cb-cedd-4afc-a299-85cf660201e6 tempest-CreateVolumesFromSnapshotTest-323228305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:59:01 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-46cf33cb-cedd-4afc-a299-85cf660201e6 tempest-CreateVolumesFromSnapshotTest-323228305 None] Flow 'volume_create_manager' (3e26447c-a34f-42ab-93c1-6560f6355ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:59:01 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-46cf33cb-cedd-4afc-a299-85cf660201e6 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c04d816-4bc8-42ee-8205-5093a5145e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:01 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-46cf33cb-cedd-4afc-a299-85cf660201e6 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c04d816-4bc8-42ee-8205-5093a5145e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-171359127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db0155c8-287f-4c1d-89d4-50499ce19c83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b343905d55542e5975ceeb4e7db62b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:59:02Z,use_quota=True,user_id='a9d93529cca74aeeb26c17800ea796b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:01 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-46cf33cb-cedd-4afc-a299-85cf660201e6 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f30862c9-a89f-481e-b65f-c678dd7718b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:02 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-46cf33cb-cedd-4afc-a299-85cf660201e6 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f30862c9-a89f-481e-b65f-c678dd7718b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:02 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-46cf33cb-cedd-4afc-a299-85cf660201e6 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (007b325d-74d3-44c2-aaa1-39178e936d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:02 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-46cf33cb-cedd-4afc-a299-85cf660201e6 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (007b325d-74d3-44c2-aaa1-39178e936d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db0155c8-287f-4c1d-89d4-50499ce19c83', 'volume_name': 'volume-db0155c8-287f-4c1d-89d4-50499ce19c83', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:02 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-46cf33cb-cedd-4afc-a299-85cf660201e6 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7651f47d-dc70-4dbe-8bd9-2b5b0a078dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:02 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-46cf33cb-cedd-4afc-a299-85cf660201e6 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7651f47d-dc70-4dbe-8bd9-2b5b0a078dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:02 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-46cf33cb-cedd-4afc-a299-85cf660201e6 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71ee33f0-23a3-46e3-af91-e53c2bcadd4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:02 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-46cf33cb-cedd-4afc-a299-85cf660201e6 tempest-CreateVolumesFromSnapshotTest-323228305 None] Volume db0155c8-287f-4c1d-89d4-50499ce19c83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db0155c8-287f-4c1d-89d4-50499ce19c83', 'volume_size': 1} Apr 24 13:59:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-46cf33cb-cedd-4afc-a299-85cf660201e6 tempest-CreateVolumesFromSnapshotTest-323228305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:59:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-053d0d8a-4383-44bf-b62e-c5facf6e25b8 tempest-CreateVolumesFromImageTest-1479598366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:59:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-053d0d8a-4383-44bf-b62e-c5facf6e25b8 tempest-CreateVolumesFromImageTest-1479598366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:59:02 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-053d0d8a-4383-44bf-b62e-c5facf6e25b8 tempest-CreateVolumesFromImageTest-1479598366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:59:02 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-053d0d8a-4383-44bf-b62e-c5facf6e25b8 tempest-CreateVolumesFromImageTest-1479598366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:59:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-053d0d8a-4383-44bf-b62e-c5facf6e25b8 tempest-CreateVolumesFromImageTest-1479598366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:59:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-053d0d8a-4383-44bf-b62e-c5facf6e25b8 tempest-CreateVolumesFromImageTest-1479598366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:02 devstack sudo[91204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:59:02 devstack sudo[91204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:03 devstack sudo[91204]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-053d0d8a-4383-44bf-b62e-c5facf6e25b8 tempest-CreateVolumesFromImageTest-1479598366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 1.196s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:03 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-053d0d8a-4383-44bf-b62e-c5facf6e25b8 tempest-CreateVolumesFromImageTest-1479598366 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:59:03 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-053d0d8a-4383-44bf-b62e-c5facf6e25b8 tempest-CreateVolumesFromImageTest-1479598366 None] Deleted volume successfully. Apr 24 13:59:03 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-053d0d8a-4383-44bf-b62e-c5facf6e25b8 tempest-CreateVolumesFromImageTest-1479598366 None] Lock "cinder-30f97cb0-acda-4947-9ab9-0154da5bc324-delete_volume" released by "delete_volume" :: held 3.715s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:59:06 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-659d5ae3-2fb6-4fac-80a0-1debcdb1fe00 tempest-SnapshotDependencyTests-704110802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:59:06 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-659d5ae3-2fb6-4fac-80a0-1debcdb1fe00 tempest-SnapshotDependencyTests-704110802 None] Flow 'volume_create_manager' (0df47fc0-edb9-4fd0-96c0-fbb1f755405c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:59:06 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-659d5ae3-2fb6-4fac-80a0-1debcdb1fe00 tempest-SnapshotDependencyTests-704110802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f03551e1-6f3a-4673-9021-ecdc67d52a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:06 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-659d5ae3-2fb6-4fac-80a0-1debcdb1fe00 tempest-SnapshotDependencyTests-704110802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f03551e1-6f3a-4673-9021-ecdc67d52a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1202276318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75233b5d-1a06-4fcc-a057-5d525e7af8e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db0c4204125245cd8aa3c63bed45e0c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:59:06Z,use_quota=True,user_id='65f6ee0b59b4450286a28ab9485c3bd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:06 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-659d5ae3-2fb6-4fac-80a0-1debcdb1fe00 tempest-SnapshotDependencyTests-704110802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8a400b6-af83-4ba0-b296-4da9801f49a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:06 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-659d5ae3-2fb6-4fac-80a0-1debcdb1fe00 tempest-SnapshotDependencyTests-704110802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8a400b6-af83-4ba0-b296-4da9801f49a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:06 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-659d5ae3-2fb6-4fac-80a0-1debcdb1fe00 tempest-SnapshotDependencyTests-704110802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (867d0e25-3c8c-4b11-b774-a9abfafe9b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:06 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-659d5ae3-2fb6-4fac-80a0-1debcdb1fe00 tempest-SnapshotDependencyTests-704110802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (867d0e25-3c8c-4b11-b774-a9abfafe9b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75233b5d-1a06-4fcc-a057-5d525e7af8e7', 'volume_name': 'volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:06 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-659d5ae3-2fb6-4fac-80a0-1debcdb1fe00 tempest-SnapshotDependencyTests-704110802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55f60f1e-cbe5-47a0-b104-7c0942c24ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:06 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-659d5ae3-2fb6-4fac-80a0-1debcdb1fe00 tempest-SnapshotDependencyTests-704110802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55f60f1e-cbe5-47a0-b104-7c0942c24ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:06 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-659d5ae3-2fb6-4fac-80a0-1debcdb1fe00 tempest-SnapshotDependencyTests-704110802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb8a5597-0aa4-434b-b837-eeb6bd7c53fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:06 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-659d5ae3-2fb6-4fac-80a0-1debcdb1fe00 tempest-SnapshotDependencyTests-704110802 None] Volume 75233b5d-1a06-4fcc-a057-5d525e7af8e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7', 'volume_size': 1} Apr 24 13:59:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-659d5ae3-2fb6-4fac-80a0-1debcdb1fe00 tempest-SnapshotDependencyTests-704110802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:59:08 devstack sudo[91198]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d68173d1-3ad0-46c2-9752-7cc2887b847d" returned: 0 in 7.419s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:08 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb319fe0-7c28-425a-9421-3c0ac8a1c847]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:59:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:08 devstack sudo[91215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c Apr 24 13:59:08 devstack sudo[91215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:08 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-269dbfb3-54d0-4df9-a952-96eab199c926 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:59:08 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-269dbfb3-54d0-4df9-a952-96eab199c926 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Flow 'volume_create_manager' (2a2bcf3f-d9bf-4a04-868f-a7daa950e644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:59:08 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-269dbfb3-54d0-4df9-a952-96eab199c926 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e10b8272-a064-4a14-9b6f-6b73f7d06c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:08 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-269dbfb3-54d0-4df9-a952-96eab199c926 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e10b8272-a064-4a14-9b6f-6b73f7d06c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-113780619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b935e661-9c8b-47e7-9e74-dad6a0218ae4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='615d789bb4dd4a3ca71c1ec449f20ba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:59:09Z,use_quota=True,user_id='542d00693e2741a1bb7698649b0d9b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:08 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-269dbfb3-54d0-4df9-a952-96eab199c926 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77a156cc-0b17-4714-81f7-dfd54ec2a6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:08 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-269dbfb3-54d0-4df9-a952-96eab199c926 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77a156cc-0b17-4714-81f7-dfd54ec2a6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:08 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-269dbfb3-54d0-4df9-a952-96eab199c926 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8923ca6f-685f-465a-bcc8-df46d9973fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:08 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-269dbfb3-54d0-4df9-a952-96eab199c926 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8923ca6f-685f-465a-bcc8-df46d9973fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b935e661-9c8b-47e7-9e74-dad6a0218ae4', 'volume_name': 'volume-b935e661-9c8b-47e7-9e74-dad6a0218ae4', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:08 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-269dbfb3-54d0-4df9-a952-96eab199c926 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c9e157c-2b45-45f7-82ed-b958bff59c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:08 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-269dbfb3-54d0-4df9-a952-96eab199c926 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c9e157c-2b45-45f7-82ed-b958bff59c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:08 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-269dbfb3-54d0-4df9-a952-96eab199c926 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83879c7a-e34b-494b-b71e-3d87b12854a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:08 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-269dbfb3-54d0-4df9-a952-96eab199c926 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Volume b935e661-9c8b-47e7-9e74-dad6a0218ae4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b935e661-9c8b-47e7-9e74-dad6a0218ae4', 'volume_size': 1} Apr 24 13:59:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-269dbfb3-54d0-4df9-a952-96eab199c926 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:59:09 devstack sudo[91215]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c" returned: 0 in 0.774s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:09 devstack cinder-volume[82046]: DEBUG cinder.image.image_utils [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] Image conversion details: src /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c, size 1024.00 MB, duration 7.42 sec, destination /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d68173d1-3ad0-46c2-9752-7cc2887b847d {{(pid=82046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 13:59:09 devstack cinder-volume[82046]: INFO cinder.image.image_utils [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] Converted 1024.00 MB image at 138.00 MB/s Apr 24 13:59:09 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d68173d1-3ad0-46c2-9752-7cc2887b847d is being set with open permissions: ugo+rw Apr 24 13:59:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d68173d1-3ad0-46c2-9752-7cc2887b847d {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:09 devstack sudo[91220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d68173d1-3ad0-46c2-9752-7cc2887b847d Apr 24 13:59:09 devstack sudo[91220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:09 devstack sudo[91220]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d68173d1-3ad0-46c2-9752-7cc2887b847d" returned: 0 in 0.467s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:09 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] Lock "cinder-quobyte-d68173d1-3ad0-46c2-9752-7cc2887b847d" released by "_copy_volume_from_snapshot" :: held 10.912s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:59:09 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] Lock "cinder-quobyte-39dca2e5-db0e-4e48-8dc3-d615ef6299a3-d68173d1-3ad0-46c2-9752-7cc2887b847d" released by "_create_volume_from_snapshot" :: held 10.955s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:59:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.992s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:59:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b36a1cf1-7132-4e0a-9b98-42dbf8fe0d02 tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.826s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:59:09 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b36a1cf1-7132-4e0a-9b98-42dbf8fe0d02 tempest-CreateVolumesFromSnapshotTest-323228305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-530173595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e6444cb-a300-460e-8cfe-0e1cac3bb5ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b343905d55542e5975ceeb4e7db62b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:59:00Z,use_quota=True,user_id='a9d93529cca74aeeb26c17800ea796b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:59:09 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-b36a1cf1-7132-4e0a-9b98-42dbf8fe0d02 tempest-CreateVolumesFromSnapshotTest-323228305 None] Creating volume 8e6444cb-a300-460e-8cfe-0e1cac3bb5ca {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:59:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b36a1cf1-7132-4e0a-9b98-42dbf8fe0d02 tempest-CreateVolumesFromSnapshotTest-323228305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:59:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b36a1cf1-7132-4e0a-9b98-42dbf8fe0d02 tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:59:09 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b36a1cf1-7132-4e0a-9b98-42dbf8fe0d02 tempest-CreateVolumesFromSnapshotTest-323228305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:59:09 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b36a1cf1-7132-4e0a-9b98-42dbf8fe0d02 tempest-CreateVolumesFromSnapshotTest-323228305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:59:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b36a1cf1-7132-4e0a-9b98-42dbf8fe0d02 tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:59:09 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b36a1cf1-7132-4e0a-9b98-42dbf8fe0d02 tempest-CreateVolumesFromSnapshotTest-323228305 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:59:09 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-b36a1cf1-7132-4e0a-9b98-42dbf8fe0d02 tempest-CreateVolumesFromSnapshotTest-323228305 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:59:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b36a1cf1-7132-4e0a-9b98-42dbf8fe0d02 tempest-CreateVolumesFromSnapshotTest-323228305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-8e6444cb-a300-460e-8cfe-0e1cac3bb5ca 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:09 devstack sudo[91223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-8e6444cb-a300-460e-8cfe-0e1cac3bb5ca 1073741824 Apr 24 13:59:09 devstack sudo[91223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:09 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7ed71f0-0b84-485a-9605-7dae3fd4e883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d68173d1-3ad0-46c2-9752-7cc2887b847d', 'volume_size': 1, 'snapshot_id': '39dca2e5-db0e-4e48-8dc3-d615ef6299a3'}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:09 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0df884c6-4e63-4d7e-bc2a-b20f1473a159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:09 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] Volume volume-d68173d1-3ad0-46c2-9752-7cc2887b847d (d68173d1-3ad0-46c2-9752-7cc2887b847d): created successfully Apr 24 13:59:09 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0df884c6-4e63-4d7e-bc2a-b20f1473a159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:09 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] Flow 'volume_create_manager' (09ffdffe-f390-4e60-8928-159043c67dd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:59:09 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-115fee92-0375-4be3-9822-1bbe8b611e41 tempest-VolumeDependencyTests-1150031044 None] Created volume successfully. Apr 24 13:59:10 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-452b211b-a339-425b-a35f-d21c1d920fca tempest-VolumeDependencyTests-1150031044 None] Acquiring lock "cinder-39dca2e5-db0e-4e48-8dc3-d615ef6299a3-delete_snapshot" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:59:10 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-452b211b-a339-425b-a35f-d21c1d920fca tempest-VolumeDependencyTests-1150031044 None] Lock "cinder-39dca2e5-db0e-4e48-8dc3-d615ef6299a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:59:10 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-452b211b-a339-425b-a35f-d21c1d920fca tempest-VolumeDependencyTests-1150031044 None] Acquiring lock "cinder-quobyte-c0cab67b-8220-4294-ae29-28e0541a9e5c" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:59:10 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-452b211b-a339-425b-a35f-d21c1d920fca tempest-VolumeDependencyTests-1150031044 None] Lock "cinder-quobyte-c0cab67b-8220-4294-ae29-28e0541a9e5c" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:59:10 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-452b211b-a339-425b-a35f-d21c1d920fca tempest-VolumeDependencyTests-1150031044 None] Acquiring lock "cinder-quobyte-39dca2e5-db0e-4e48-8dc3-d615ef6299a3" by "_delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:59:10 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-452b211b-a339-425b-a35f-d21c1d920fca tempest-VolumeDependencyTests-1150031044 None] Lock "cinder-quobyte-39dca2e5-db0e-4e48-8dc3-d615ef6299a3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:59:10 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-452b211b-a339-425b-a35f-d21c1d920fca tempest-VolumeDependencyTests-1150031044 None] Deleting offline snapshot 39dca2e5-db0e-4e48-8dc3-d615ef6299a3 of volume c0cab67b-8220-4294-ae29-28e0541a9e5c {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 13:59:10 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-452b211b-a339-425b-a35f-d21c1d920fca tempest-VolumeDependencyTests-1150031044 None] snapshot_file for this snap is: volume-c0cab67b-8220-4294-ae29-28e0541a9e5c.39dca2e5-db0e-4e48-8dc3-d615ef6299a3 {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 13:59:10 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3dee146-e5a5-483f-8580-b7e15ef7159b]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:59:10 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-452b211b-a339-425b-a35f-d21c1d920fca tempest-VolumeDependencyTests-1150031044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c.39dca2e5-db0e-4e48-8dc3-d615ef6299a3 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:10 devstack sudo[91223]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:10 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b36a1cf1-7132-4e0a-9b98-42dbf8fe0d02 tempest-CreateVolumesFromSnapshotTest-323228305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-8e6444cb-a300-460e-8cfe-0e1cac3bb5ca 1073741824" returned: 0 in 0.691s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:10 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b36a1cf1-7132-4e0a-9b98-42dbf8fe0d02 tempest-CreateVolumesFromSnapshotTest-323228305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-8e6444cb-a300-460e-8cfe-0e1cac3bb5ca {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:10 devstack sudo[91228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c.39dca2e5-db0e-4e48-8dc3-d615ef6299a3 Apr 24 13:59:10 devstack sudo[91228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:10 devstack sudo[91229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-8e6444cb-a300-460e-8cfe-0e1cac3bb5ca Apr 24 13:59:10 devstack sudo[91229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:11 devstack sudo[91229]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b36a1cf1-7132-4e0a-9b98-42dbf8fe0d02 tempest-CreateVolumesFromSnapshotTest-323228305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-8e6444cb-a300-460e-8cfe-0e1cac3bb5ca" returned: 0 in 0.496s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:11 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b36a1cf1-7132-4e0a-9b98-42dbf8fe0d02 tempest-CreateVolumesFromSnapshotTest-323228305 None] <== create_volume: return (1232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:59:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b36a1cf1-7132-4e0a-9b98-42dbf8fe0d02 tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:59:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-50ed8f2f-2a77-4681-aa55-079369469a29 tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.562s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:59:11 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-50ed8f2f-2a77-4681-aa55-079369469a29 tempest-CreateVolumesFromSnapshotTest-323228305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-918170834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db9096a6-e914-4b96-87e3-9271d466c3ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b343905d55542e5975ceeb4e7db62b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:59:00Z,use_quota=True,user_id='a9d93529cca74aeeb26c17800ea796b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:59:11 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-50ed8f2f-2a77-4681-aa55-079369469a29 tempest-CreateVolumesFromSnapshotTest-323228305 None] Creating volume db9096a6-e914-4b96-87e3-9271d466c3ad {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:59:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-50ed8f2f-2a77-4681-aa55-079369469a29 tempest-CreateVolumesFromSnapshotTest-323228305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:59:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-50ed8f2f-2a77-4681-aa55-079369469a29 tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:59:11 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-50ed8f2f-2a77-4681-aa55-079369469a29 tempest-CreateVolumesFromSnapshotTest-323228305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:59:11 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-50ed8f2f-2a77-4681-aa55-079369469a29 tempest-CreateVolumesFromSnapshotTest-323228305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:59:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-50ed8f2f-2a77-4681-aa55-079369469a29 tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:59:11 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-50ed8f2f-2a77-4681-aa55-079369469a29 tempest-CreateVolumesFromSnapshotTest-323228305 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:59:11 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-50ed8f2f-2a77-4681-aa55-079369469a29 tempest-CreateVolumesFromSnapshotTest-323228305 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:59:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-50ed8f2f-2a77-4681-aa55-079369469a29 tempest-CreateVolumesFromSnapshotTest-323228305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-db9096a6-e914-4b96-87e3-9271d466c3ad 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:11 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b36a1cf1-7132-4e0a-9b98-42dbf8fe0d02 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e98bb72f-4d4f-4913-9a02-b7bc7a2ab602) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e6444cb-a300-460e-8cfe-0e1cac3bb5ca', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:11 devstack sudo[91236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-db9096a6-e914-4b96-87e3-9271d466c3ad 1073741824 Apr 24 13:59:11 devstack sudo[91236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:11 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b36a1cf1-7132-4e0a-9b98-42dbf8fe0d02 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f7b8689-02bc-4ae8-9ba0-ebaf0ff42cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:11 devstack sudo[91228]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-452b211b-a339-425b-a35f-d21c1d920fca tempest-VolumeDependencyTests-1150031044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c.39dca2e5-db0e-4e48-8dc3-d615ef6299a3" returned: 0 in 0.647s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:11 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-452b211b-a339-425b-a35f-d21c1d920fca tempest-VolumeDependencyTests-1150031044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0cab67b-8220-4294-ae29-28e0541a9e5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:59:11 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-b36a1cf1-7132-4e0a-9b98-42dbf8fe0d02 tempest-CreateVolumesFromSnapshotTest-323228305 None] Volume volume-8e6444cb-a300-460e-8cfe-0e1cac3bb5ca (8e6444cb-a300-460e-8cfe-0e1cac3bb5ca): created successfully Apr 24 13:59:11 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b36a1cf1-7132-4e0a-9b98-42dbf8fe0d02 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f7b8689-02bc-4ae8-9ba0-ebaf0ff42cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:11 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b36a1cf1-7132-4e0a-9b98-42dbf8fe0d02 tempest-CreateVolumesFromSnapshotTest-323228305 None] Flow 'volume_create_manager' (f13195b7-b504-43ca-b8a9-44f6adcc2e1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:59:11 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9cd8c3f-4087-4186-a392-858496d7d271]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:59:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-452b211b-a339-425b-a35f-d21c1d920fca tempest-VolumeDependencyTests-1150031044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:11 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-b36a1cf1-7132-4e0a-9b98-42dbf8fe0d02 tempest-CreateVolumesFromSnapshotTest-323228305 None] Created volume successfully. Apr 24 13:59:11 devstack sudo[91238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c Apr 24 13:59:11 devstack sudo[91238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:11 devstack sudo[91236]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-50ed8f2f-2a77-4681-aa55-079369469a29 tempest-CreateVolumesFromSnapshotTest-323228305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-db9096a6-e914-4b96-87e3-9271d466c3ad 1073741824" returned: 0 in 0.724s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-50ed8f2f-2a77-4681-aa55-079369469a29 tempest-CreateVolumesFromSnapshotTest-323228305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-db9096a6-e914-4b96-87e3-9271d466c3ad {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:11 devstack sudo[91238]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-452b211b-a339-425b-a35f-d21c1d920fca tempest-VolumeDependencyTests-1150031044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c" returned: 0 in 0.688s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-452b211b-a339-425b-a35f-d21c1d920fca tempest-VolumeDependencyTests-1150031044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c.39dca2e5-db0e-4e48-8dc3-d615ef6299a3 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:11 devstack sudo[91246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-db9096a6-e914-4b96-87e3-9271d466c3ad Apr 24 13:59:11 devstack sudo[91246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:11 devstack sudo[91247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c.39dca2e5-db0e-4e48-8dc3-d615ef6299a3 Apr 24 13:59:11 devstack sudo[91247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:12 devstack sudo[91246]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-50ed8f2f-2a77-4681-aa55-079369469a29 tempest-CreateVolumesFromSnapshotTest-323228305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-db9096a6-e914-4b96-87e3-9271d466c3ad" returned: 0 in 0.515s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:12 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-50ed8f2f-2a77-4681-aa55-079369469a29 tempest-CreateVolumesFromSnapshotTest-323228305 None] <== create_volume: return (1294ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:59:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-50ed8f2f-2a77-4681-aa55-079369469a29 tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.301s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:59:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a61d3a21-fe97-481d-90fa-e71cb7f78b10 tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.262s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:59:12 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a61d3a21-fe97-481d-90fa-e71cb7f78b10 tempest-CreateVolumesFromSnapshotTest-323228305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-39064707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9254918-44ae-4b5a-ab69-0a9ef551f0f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b343905d55542e5975ceeb4e7db62b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:59:01Z,use_quota=True,user_id='a9d93529cca74aeeb26c17800ea796b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:59:12 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-a61d3a21-fe97-481d-90fa-e71cb7f78b10 tempest-CreateVolumesFromSnapshotTest-323228305 None] Creating volume a9254918-44ae-4b5a-ab69-0a9ef551f0f0 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:59:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a61d3a21-fe97-481d-90fa-e71cb7f78b10 tempest-CreateVolumesFromSnapshotTest-323228305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:59:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a61d3a21-fe97-481d-90fa-e71cb7f78b10 tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:59:12 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a61d3a21-fe97-481d-90fa-e71cb7f78b10 tempest-CreateVolumesFromSnapshotTest-323228305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:59:12 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a61d3a21-fe97-481d-90fa-e71cb7f78b10 tempest-CreateVolumesFromSnapshotTest-323228305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:59:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a61d3a21-fe97-481d-90fa-e71cb7f78b10 tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:59:12 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a61d3a21-fe97-481d-90fa-e71cb7f78b10 tempest-CreateVolumesFromSnapshotTest-323228305 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:59:12 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-a61d3a21-fe97-481d-90fa-e71cb7f78b10 tempest-CreateVolumesFromSnapshotTest-323228305 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:59:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a61d3a21-fe97-481d-90fa-e71cb7f78b10 tempest-CreateVolumesFromSnapshotTest-323228305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a9254918-44ae-4b5a-ab69-0a9ef551f0f0 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:12 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-50ed8f2f-2a77-4681-aa55-079369469a29 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23d18ec9-b98e-4a93-b6f1-0e6a6511eccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db9096a6-e914-4b96-87e3-9271d466c3ad', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:12 devstack sudo[91254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a9254918-44ae-4b5a-ab69-0a9ef551f0f0 1073741824 Apr 24 13:59:12 devstack sudo[91254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:12 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-50ed8f2f-2a77-4681-aa55-079369469a29 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (595e3672-dce1-48b5-ac9b-c4c36cd14bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:12 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-50ed8f2f-2a77-4681-aa55-079369469a29 tempest-CreateVolumesFromSnapshotTest-323228305 None] Volume volume-db9096a6-e914-4b96-87e3-9271d466c3ad (db9096a6-e914-4b96-87e3-9271d466c3ad): created successfully Apr 24 13:59:12 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-50ed8f2f-2a77-4681-aa55-079369469a29 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (595e3672-dce1-48b5-ac9b-c4c36cd14bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:12 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-50ed8f2f-2a77-4681-aa55-079369469a29 tempest-CreateVolumesFromSnapshotTest-323228305 None] Flow 'volume_create_manager' (c266ab32-b039-4b9c-8c5e-3fe4826281f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:59:12 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-50ed8f2f-2a77-4681-aa55-079369469a29 tempest-CreateVolumesFromSnapshotTest-323228305 None] Created volume successfully. Apr 24 13:59:12 devstack sudo[91247]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-452b211b-a339-425b-a35f-d21c1d920fca tempest-VolumeDependencyTests-1150031044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c.39dca2e5-db0e-4e48-8dc3-d615ef6299a3" returned: 0 in 0.712s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-452b211b-a339-425b-a35f-d21c1d920fca tempest-VolumeDependencyTests-1150031044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c.39dca2e5-db0e-4e48-8dc3-d615ef6299a3 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:12 devstack sudo[91256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c.39dca2e5-db0e-4e48-8dc3-d615ef6299a3 Apr 24 13:59:12 devstack sudo[91256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:13 devstack sudo[91254]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a61d3a21-fe97-481d-90fa-e71cb7f78b10 tempest-CreateVolumesFromSnapshotTest-323228305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a9254918-44ae-4b5a-ab69-0a9ef551f0f0 1073741824" returned: 0 in 0.697s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a61d3a21-fe97-481d-90fa-e71cb7f78b10 tempest-CreateVolumesFromSnapshotTest-323228305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a9254918-44ae-4b5a-ab69-0a9ef551f0f0 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:13 devstack sudo[91256]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-452b211b-a339-425b-a35f-d21c1d920fca tempest-VolumeDependencyTests-1150031044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c.39dca2e5-db0e-4e48-8dc3-d615ef6299a3" returned: 0 in 0.545s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:13 devstack sudo[91262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a9254918-44ae-4b5a-ab69-0a9ef551f0f0 Apr 24 13:59:13 devstack sudo[91262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:13 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-452b211b-a339-425b-a35f-d21c1d920fca tempest-VolumeDependencyTests-1150031044 None] Lock "cinder-quobyte-39dca2e5-db0e-4e48-8dc3-d615ef6299a3" released by "_delete_snapshot" :: held 2.732s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:59:13 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-452b211b-a339-425b-a35f-d21c1d920fca tempest-VolumeDependencyTests-1150031044 None] Lock "cinder-quobyte-c0cab67b-8220-4294-ae29-28e0541a9e5c" released by "delete_snapshot" :: held 2.758s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:59:13 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-452b211b-a339-425b-a35f-d21c1d920fca tempest-VolumeDependencyTests-1150031044 None] Created reservations ['54f28f45-0ae2-4c1a-9990-18ba4167f9ba', '96d7751d-a806-4e91-8cd1-5e48443a3fdc', '23bf3c36-d477-40c9-b258-770055656c17', 'fbee9ba1-9801-4ed7-bcb2-616c6c84bb22'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:59:13 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-452b211b-a339-425b-a35f-d21c1d920fca tempest-VolumeDependencyTests-1150031044 None] Delete snapshot completed successfully. Apr 24 13:59:13 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-452b211b-a339-425b-a35f-d21c1d920fca tempest-VolumeDependencyTests-1150031044 None] Lock "cinder-39dca2e5-db0e-4e48-8dc3-d615ef6299a3-delete_snapshot" released by "delete_snapshot" :: held 2.924s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:59:13 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-37f7dc16-3a2e-4fa6-b031-6d228241a2d2 tempest-VolumeDependencyTests-1150031044 None] Acquiring lock "cinder-c0cab67b-8220-4294-ae29-28e0541a9e5c-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:59:13 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-37f7dc16-3a2e-4fa6-b031-6d228241a2d2 tempest-VolumeDependencyTests-1150031044 None] Lock "cinder-c0cab67b-8220-4294-ae29-28e0541a9e5c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:59:13 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-37f7dc16-3a2e-4fa6-b031-6d228241a2d2 tempest-VolumeDependencyTests-1150031044 None] Acquiring lock "cinder-quobyte-c0cab67b-8220-4294-ae29-28e0541a9e5c" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:59:13 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-37f7dc16-3a2e-4fa6-b031-6d228241a2d2 tempest-VolumeDependencyTests-1150031044 None] Lock "cinder-quobyte-c0cab67b-8220-4294-ae29-28e0541a9e5c" acquired by "delete_volume" :: waited 0.019s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:59:13 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[847f92a0-1581-41f4-82ca-695ea133b090]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:59:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-37f7dc16-3a2e-4fa6-b031-6d228241a2d2 tempest-VolumeDependencyTests-1150031044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:13 devstack sudo[91262]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a61d3a21-fe97-481d-90fa-e71cb7f78b10 tempest-CreateVolumesFromSnapshotTest-323228305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a9254918-44ae-4b5a-ab69-0a9ef551f0f0" returned: 0 in 0.615s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:13 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a61d3a21-fe97-481d-90fa-e71cb7f78b10 tempest-CreateVolumesFromSnapshotTest-323228305 None] <== create_volume: return (1359ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:59:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a61d3a21-fe97-481d-90fa-e71cb7f78b10 tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.362s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:59:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-debbcbd9-20d7-40f4-b08f-735e97496d89 tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.179s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:59:13 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-debbcbd9-20d7-40f4-b08f-735e97496d89 tempest-CreateVolumesFromSnapshotTest-323228305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-66539908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=589112d4-be7e-4f53-9218-65c0dfbc1ec1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b343905d55542e5975ceeb4e7db62b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:59:01Z,use_quota=True,user_id='a9d93529cca74aeeb26c17800ea796b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:59:13 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-debbcbd9-20d7-40f4-b08f-735e97496d89 tempest-CreateVolumesFromSnapshotTest-323228305 None] Creating volume 589112d4-be7e-4f53-9218-65c0dfbc1ec1 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:59:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-debbcbd9-20d7-40f4-b08f-735e97496d89 tempest-CreateVolumesFromSnapshotTest-323228305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:59:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-debbcbd9-20d7-40f4-b08f-735e97496d89 tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:59:13 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-debbcbd9-20d7-40f4-b08f-735e97496d89 tempest-CreateVolumesFromSnapshotTest-323228305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:59:13 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-debbcbd9-20d7-40f4-b08f-735e97496d89 tempest-CreateVolumesFromSnapshotTest-323228305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:59:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-debbcbd9-20d7-40f4-b08f-735e97496d89 tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:59:13 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-debbcbd9-20d7-40f4-b08f-735e97496d89 tempest-CreateVolumesFromSnapshotTest-323228305 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:59:13 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-debbcbd9-20d7-40f4-b08f-735e97496d89 tempest-CreateVolumesFromSnapshotTest-323228305 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:59:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-debbcbd9-20d7-40f4-b08f-735e97496d89 tempest-CreateVolumesFromSnapshotTest-323228305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-589112d4-be7e-4f53-9218-65c0dfbc1ec1 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:13 devstack sudo[91266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-589112d4-be7e-4f53-9218-65c0dfbc1ec1 1073741824 Apr 24 13:59:13 devstack sudo[91266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:13 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a61d3a21-fe97-481d-90fa-e71cb7f78b10 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba861d3c-4426-4108-be8a-e76235e3aff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9254918-44ae-4b5a-ab69-0a9ef551f0f0', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:13 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a61d3a21-fe97-481d-90fa-e71cb7f78b10 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62aa9345-5156-4138-a3c2-4e676bc5a52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:13 devstack sudo[91265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c Apr 24 13:59:13 devstack sudo[91265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:13 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-a61d3a21-fe97-481d-90fa-e71cb7f78b10 tempest-CreateVolumesFromSnapshotTest-323228305 None] Volume volume-a9254918-44ae-4b5a-ab69-0a9ef551f0f0 (a9254918-44ae-4b5a-ab69-0a9ef551f0f0): created successfully Apr 24 13:59:13 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a61d3a21-fe97-481d-90fa-e71cb7f78b10 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62aa9345-5156-4138-a3c2-4e676bc5a52c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:13 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a61d3a21-fe97-481d-90fa-e71cb7f78b10 tempest-CreateVolumesFromSnapshotTest-323228305 None] Flow 'volume_create_manager' (f1f5b2cf-e38f-497e-9eaa-714d803bbc89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:59:13 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-a61d3a21-fe97-481d-90fa-e71cb7f78b10 tempest-CreateVolumesFromSnapshotTest-323228305 None] Created volume successfully. Apr 24 13:59:14 devstack sudo[91265]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-37f7dc16-3a2e-4fa6-b031-6d228241a2d2 tempest-VolumeDependencyTests-1150031044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c" returned: 0 in 0.668s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-37f7dc16-3a2e-4fa6-b031-6d228241a2d2 tempest-VolumeDependencyTests-1150031044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:14 devstack sudo[91275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c Apr 24 13:59:14 devstack sudo[91275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:14 devstack sudo[91266]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-debbcbd9-20d7-40f4-b08f-735e97496d89 tempest-CreateVolumesFromSnapshotTest-323228305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-589112d4-be7e-4f53-9218-65c0dfbc1ec1 1073741824" returned: 0 in 0.705s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-debbcbd9-20d7-40f4-b08f-735e97496d89 tempest-CreateVolumesFromSnapshotTest-323228305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-589112d4-be7e-4f53-9218-65c0dfbc1ec1 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:14 devstack sudo[91277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-589112d4-be7e-4f53-9218-65c0dfbc1ec1 Apr 24 13:59:14 devstack sudo[91277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:14 devstack sudo[91275]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-37f7dc16-3a2e-4fa6-b031-6d228241a2d2 tempest-VolumeDependencyTests-1150031044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-c0cab67b-8220-4294-ae29-28e0541a9e5c" returned: 0 in 0.500s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:14 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-37f7dc16-3a2e-4fa6-b031-6d228241a2d2 tempest-VolumeDependencyTests-1150031044 None] Lock "cinder-quobyte-c0cab67b-8220-4294-ae29-28e0541a9e5c" released by "delete_volume" :: held 1.236s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:59:14 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-37f7dc16-3a2e-4fa6-b031-6d228241a2d2 tempest-VolumeDependencyTests-1150031044 None] Created reservations ['d04de17d-3d10-4024-9b8a-8ad1097d1936', 'de1e1dd3-d839-4c59-95c3-d60f5fa4ce67', '45d3ff24-f9cc-48b6-920f-0dd52a581b47', 'b539c47a-f431-4a74-89f0-c809f8b801bf'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:59:15 devstack sudo[91277]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-debbcbd9-20d7-40f4-b08f-735e97496d89 tempest-CreateVolumesFromSnapshotTest-323228305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-589112d4-be7e-4f53-9218-65c0dfbc1ec1" returned: 0 in 0.513s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:15 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-debbcbd9-20d7-40f4-b08f-735e97496d89 tempest-CreateVolumesFromSnapshotTest-323228305 None] <== create_volume: return (1270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:59:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-debbcbd9-20d7-40f4-b08f-735e97496d89 tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.273s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:59:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-46cf33cb-cedd-4afc-a299-85cf660201e6 tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.016s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:59:15 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-46cf33cb-cedd-4afc-a299-85cf660201e6 tempest-CreateVolumesFromSnapshotTest-323228305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-171359127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db0155c8-287f-4c1d-89d4-50499ce19c83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b343905d55542e5975ceeb4e7db62b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:59:02Z,use_quota=True,user_id='a9d93529cca74aeeb26c17800ea796b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:59:15 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-46cf33cb-cedd-4afc-a299-85cf660201e6 tempest-CreateVolumesFromSnapshotTest-323228305 None] Creating volume db0155c8-287f-4c1d-89d4-50499ce19c83 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:59:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-46cf33cb-cedd-4afc-a299-85cf660201e6 tempest-CreateVolumesFromSnapshotTest-323228305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:59:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-46cf33cb-cedd-4afc-a299-85cf660201e6 tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:59:15 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-46cf33cb-cedd-4afc-a299-85cf660201e6 tempest-CreateVolumesFromSnapshotTest-323228305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:59:15 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-46cf33cb-cedd-4afc-a299-85cf660201e6 tempest-CreateVolumesFromSnapshotTest-323228305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:59:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-46cf33cb-cedd-4afc-a299-85cf660201e6 tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:59:15 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-46cf33cb-cedd-4afc-a299-85cf660201e6 tempest-CreateVolumesFromSnapshotTest-323228305 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:59:15 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-46cf33cb-cedd-4afc-a299-85cf660201e6 tempest-CreateVolumesFromSnapshotTest-323228305 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:59:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-46cf33cb-cedd-4afc-a299-85cf660201e6 tempest-CreateVolumesFromSnapshotTest-323228305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-db0155c8-287f-4c1d-89d4-50499ce19c83 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-37f7dc16-3a2e-4fa6-b031-6d228241a2d2 tempest-VolumeDependencyTests-1150031044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:59:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-37f7dc16-3a2e-4fa6-b031-6d228241a2d2 tempest-VolumeDependencyTests-1150031044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:59:15 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-37f7dc16-3a2e-4fa6-b031-6d228241a2d2 tempest-VolumeDependencyTests-1150031044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:59:15 devstack sudo[91281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-db0155c8-287f-4c1d-89d4-50499ce19c83 1073741824 Apr 24 13:59:15 devstack sudo[91281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:15 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-37f7dc16-3a2e-4fa6-b031-6d228241a2d2 tempest-VolumeDependencyTests-1150031044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:59:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-37f7dc16-3a2e-4fa6-b031-6d228241a2d2 tempest-VolumeDependencyTests-1150031044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:59:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-37f7dc16-3a2e-4fa6-b031-6d228241a2d2 tempest-VolumeDependencyTests-1150031044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:15 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-debbcbd9-20d7-40f4-b08f-735e97496d89 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4a1deb6-0c62-4314-916d-64a5661a4923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-589112d4-be7e-4f53-9218-65c0dfbc1ec1', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:15 devstack sudo[91283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:59:15 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-debbcbd9-20d7-40f4-b08f-735e97496d89 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46f5adb5-65df-49a1-914a-a155093d5443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:15 devstack sudo[91283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:15 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-debbcbd9-20d7-40f4-b08f-735e97496d89 tempest-CreateVolumesFromSnapshotTest-323228305 None] Volume volume-589112d4-be7e-4f53-9218-65c0dfbc1ec1 (589112d4-be7e-4f53-9218-65c0dfbc1ec1): created successfully Apr 24 13:59:15 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-debbcbd9-20d7-40f4-b08f-735e97496d89 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46f5adb5-65df-49a1-914a-a155093d5443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:15 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-debbcbd9-20d7-40f4-b08f-735e97496d89 tempest-CreateVolumesFromSnapshotTest-323228305 None] Flow 'volume_create_manager' (897f1ace-b044-4ad1-8f72-c7b3d28d616b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:59:15 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-debbcbd9-20d7-40f4-b08f-735e97496d89 tempest-CreateVolumesFromSnapshotTest-323228305 None] Created volume successfully. Apr 24 13:59:15 devstack sudo[91283]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-37f7dc16-3a2e-4fa6-b031-6d228241a2d2 tempest-VolumeDependencyTests-1150031044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.498s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:15 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-37f7dc16-3a2e-4fa6-b031-6d228241a2d2 tempest-VolumeDependencyTests-1150031044 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:59:15 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-37f7dc16-3a2e-4fa6-b031-6d228241a2d2 tempest-VolumeDependencyTests-1150031044 None] Deleted volume successfully. Apr 24 13:59:15 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-37f7dc16-3a2e-4fa6-b031-6d228241a2d2 tempest-VolumeDependencyTests-1150031044 None] Lock "cinder-c0cab67b-8220-4294-ae29-28e0541a9e5c-delete_volume" released by "delete_volume" :: held 2.000s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:59:15 devstack sudo[91281]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-46cf33cb-cedd-4afc-a299-85cf660201e6 tempest-CreateVolumesFromSnapshotTest-323228305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-db0155c8-287f-4c1d-89d4-50499ce19c83 1073741824" returned: 0 in 0.818s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-46cf33cb-cedd-4afc-a299-85cf660201e6 tempest-CreateVolumesFromSnapshotTest-323228305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-db0155c8-287f-4c1d-89d4-50499ce19c83 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:15 devstack sudo[91290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-db0155c8-287f-4c1d-89d4-50499ce19c83 Apr 24 13:59:15 devstack sudo[91290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:16 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-aad88c89-fe63-4fb3-b779-084e755a6ccb tempest-VolumeDependencyTests-1150031044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:59:16 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aad88c89-fe63-4fb3-b779-084e755a6ccb tempest-VolumeDependencyTests-1150031044 None] Flow 'volume_create_manager' (770addf9-537d-4606-98df-413422612d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:59:16 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aad88c89-fe63-4fb3-b779-084e755a6ccb tempest-VolumeDependencyTests-1150031044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (964af770-0028-41c3-81cb-6767b6d2eb2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:16 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aad88c89-fe63-4fb3-b779-084e755a6ccb tempest-VolumeDependencyTests-1150031044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (964af770-0028-41c3-81cb-6767b6d2eb2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:59:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2003640364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4e024a8-e590-4058-8266-9f96b0d66f4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f005df8063f146e6a7771f312188d27b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:59:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:59:16Z,use_quota=True,user_id='f8c84f24edbc491cab1205885eab34d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:16 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aad88c89-fe63-4fb3-b779-084e755a6ccb tempest-VolumeDependencyTests-1150031044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5226b80-9d76-4a78-9f4c-429ad98fcd6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:16 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aad88c89-fe63-4fb3-b779-084e755a6ccb tempest-VolumeDependencyTests-1150031044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5226b80-9d76-4a78-9f4c-429ad98fcd6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:16 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aad88c89-fe63-4fb3-b779-084e755a6ccb tempest-VolumeDependencyTests-1150031044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (936d473b-25cf-4e96-abd9-d167d3ebb8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:16 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aad88c89-fe63-4fb3-b779-084e755a6ccb tempest-VolumeDependencyTests-1150031044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (936d473b-25cf-4e96-abd9-d167d3ebb8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4e024a8-e590-4058-8266-9f96b0d66f4e', 'volume_name': 'volume-f4e024a8-e590-4058-8266-9f96b0d66f4e', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:16 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aad88c89-fe63-4fb3-b779-084e755a6ccb tempest-VolumeDependencyTests-1150031044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f29b96c-6906-410b-8af2-b95c7460830c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:16 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aad88c89-fe63-4fb3-b779-084e755a6ccb tempest-VolumeDependencyTests-1150031044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f29b96c-6906-410b-8af2-b95c7460830c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:16 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aad88c89-fe63-4fb3-b779-084e755a6ccb tempest-VolumeDependencyTests-1150031044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edd6b8cb-e599-4ac7-a08a-e721df212a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:16 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-aad88c89-fe63-4fb3-b779-084e755a6ccb tempest-VolumeDependencyTests-1150031044 None] Volume f4e024a8-e590-4058-8266-9f96b0d66f4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4e024a8-e590-4058-8266-9f96b0d66f4e', 'volume_size': 1} Apr 24 13:59:16 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-aad88c89-fe63-4fb3-b779-084e755a6ccb tempest-VolumeDependencyTests-1150031044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:59:16 devstack sudo[91290]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:16 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-46cf33cb-cedd-4afc-a299-85cf660201e6 tempest-CreateVolumesFromSnapshotTest-323228305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-db0155c8-287f-4c1d-89d4-50499ce19c83" returned: 0 in 0.577s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:16 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-46cf33cb-cedd-4afc-a299-85cf660201e6 tempest-CreateVolumesFromSnapshotTest-323228305 None] <== create_volume: return (1445ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:59:16 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-46cf33cb-cedd-4afc-a299-85cf660201e6 tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.448s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:59:16 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-659d5ae3-2fb6-4fac-80a0-1debcdb1fe00 tempest-SnapshotDependencyTests-704110802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.136s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:59:16 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-659d5ae3-2fb6-4fac-80a0-1debcdb1fe00 tempest-SnapshotDependencyTests-704110802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1202276318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75233b5d-1a06-4fcc-a057-5d525e7af8e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db0c4204125245cd8aa3c63bed45e0c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:59:06Z,use_quota=True,user_id='65f6ee0b59b4450286a28ab9485c3bd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:59:16 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-659d5ae3-2fb6-4fac-80a0-1debcdb1fe00 tempest-SnapshotDependencyTests-704110802 None] Creating volume 75233b5d-1a06-4fcc-a057-5d525e7af8e7 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:59:16 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-659d5ae3-2fb6-4fac-80a0-1debcdb1fe00 tempest-SnapshotDependencyTests-704110802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:59:16 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-659d5ae3-2fb6-4fac-80a0-1debcdb1fe00 tempest-SnapshotDependencyTests-704110802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:59:16 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-659d5ae3-2fb6-4fac-80a0-1debcdb1fe00 tempest-SnapshotDependencyTests-704110802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:59:16 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-659d5ae3-2fb6-4fac-80a0-1debcdb1fe00 tempest-SnapshotDependencyTests-704110802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:59:16 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-659d5ae3-2fb6-4fac-80a0-1debcdb1fe00 tempest-SnapshotDependencyTests-704110802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:59:16 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-659d5ae3-2fb6-4fac-80a0-1debcdb1fe00 tempest-SnapshotDependencyTests-704110802 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:59:16 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-659d5ae3-2fb6-4fac-80a0-1debcdb1fe00 tempest-SnapshotDependencyTests-704110802 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:59:16 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-659d5ae3-2fb6-4fac-80a0-1debcdb1fe00 tempest-SnapshotDependencyTests-704110802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:16 devstack sudo[91293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7 1073741824 Apr 24 13:59:16 devstack sudo[91293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:16 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-46cf33cb-cedd-4afc-a299-85cf660201e6 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71ee33f0-23a3-46e3-af91-e53c2bcadd4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db0155c8-287f-4c1d-89d4-50499ce19c83', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:16 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-46cf33cb-cedd-4afc-a299-85cf660201e6 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f51ef78-6c65-4ecb-8450-5cb94bf71b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:16 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-46cf33cb-cedd-4afc-a299-85cf660201e6 tempest-CreateVolumesFromSnapshotTest-323228305 None] Volume volume-db0155c8-287f-4c1d-89d4-50499ce19c83 (db0155c8-287f-4c1d-89d4-50499ce19c83): created successfully Apr 24 13:59:16 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-46cf33cb-cedd-4afc-a299-85cf660201e6 tempest-CreateVolumesFromSnapshotTest-323228305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f51ef78-6c65-4ecb-8450-5cb94bf71b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:16 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-46cf33cb-cedd-4afc-a299-85cf660201e6 tempest-CreateVolumesFromSnapshotTest-323228305 None] Flow 'volume_create_manager' (3e26447c-a34f-42ab-93c1-6560f6355ff2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:59:16 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-46cf33cb-cedd-4afc-a299-85cf660201e6 tempest-CreateVolumesFromSnapshotTest-323228305 None] Created volume successfully. Apr 24 13:59:16 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-54f06c48-9cb5-49e9-89de-473fd268fc9c tempest-CreateVolumesFromSnapshotTest-323228305 None] Acquiring lock "cinder-db0155c8-287f-4c1d-89d4-50499ce19c83-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:59:16 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-54f06c48-9cb5-49e9-89de-473fd268fc9c tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "cinder-db0155c8-287f-4c1d-89d4-50499ce19c83-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:59:16 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-54f06c48-9cb5-49e9-89de-473fd268fc9c tempest-CreateVolumesFromSnapshotTest-323228305 None] Acquiring lock "cinder-quobyte-db0155c8-287f-4c1d-89d4-50499ce19c83" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:59:16 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-54f06c48-9cb5-49e9-89de-473fd268fc9c tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "cinder-quobyte-db0155c8-287f-4c1d-89d4-50499ce19c83" acquired by "delete_volume" :: waited 0.018s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:59:16 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa7e759-5d66-47de-924f-d4e6586be0e8]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:59:16 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-54f06c48-9cb5-49e9-89de-473fd268fc9c tempest-CreateVolumesFromSnapshotTest-323228305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-db0155c8-287f-4c1d-89d4-50499ce19c83 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:17 devstack sudo[91295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-db0155c8-287f-4c1d-89d4-50499ce19c83 Apr 24 13:59:17 devstack sudo[91295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:17 devstack sudo[91293]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-659d5ae3-2fb6-4fac-80a0-1debcdb1fe00 tempest-SnapshotDependencyTests-704110802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7 1073741824" returned: 0 in 0.823s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-659d5ae3-2fb6-4fac-80a0-1debcdb1fe00 tempest-SnapshotDependencyTests-704110802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:17 devstack sudo[91300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7 Apr 24 13:59:17 devstack sudo[91300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:17 devstack sudo[91295]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-54f06c48-9cb5-49e9-89de-473fd268fc9c tempest-CreateVolumesFromSnapshotTest-323228305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-db0155c8-287f-4c1d-89d4-50499ce19c83" returned: 0 in 0.632s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-54f06c48-9cb5-49e9-89de-473fd268fc9c tempest-CreateVolumesFromSnapshotTest-323228305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-db0155c8-287f-4c1d-89d4-50499ce19c83 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:17 devstack sudo[91305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-db0155c8-287f-4c1d-89d4-50499ce19c83 Apr 24 13:59:17 devstack sudo[91305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:17 devstack sudo[91300]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-659d5ae3-2fb6-4fac-80a0-1debcdb1fe00 tempest-SnapshotDependencyTests-704110802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7" returned: 0 in 0.496s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:17 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-659d5ae3-2fb6-4fac-80a0-1debcdb1fe00 tempest-SnapshotDependencyTests-704110802 None] <== create_volume: return (1360ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:59:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-659d5ae3-2fb6-4fac-80a0-1debcdb1fe00 tempest-SnapshotDependencyTests-704110802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.363s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:59:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-269dbfb3-54d0-4df9-a952-96eab199c926 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.963s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:59:17 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-269dbfb3-54d0-4df9-a952-96eab199c926 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-113780619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b935e661-9c8b-47e7-9e74-dad6a0218ae4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='615d789bb4dd4a3ca71c1ec449f20ba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:59:09Z,use_quota=True,user_id='542d00693e2741a1bb7698649b0d9b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:59:17 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-269dbfb3-54d0-4df9-a952-96eab199c926 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Creating volume b935e661-9c8b-47e7-9e74-dad6a0218ae4 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:59:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-269dbfb3-54d0-4df9-a952-96eab199c926 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:59:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-269dbfb3-54d0-4df9-a952-96eab199c926 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:59:17 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-269dbfb3-54d0-4df9-a952-96eab199c926 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:59:17 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-269dbfb3-54d0-4df9-a952-96eab199c926 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:59:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-269dbfb3-54d0-4df9-a952-96eab199c926 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:59:17 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-269dbfb3-54d0-4df9-a952-96eab199c926 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:59:17 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-269dbfb3-54d0-4df9-a952-96eab199c926 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:59:17 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-269dbfb3-54d0-4df9-a952-96eab199c926 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b935e661-9c8b-47e7-9e74-dad6a0218ae4 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:17 devstack sudo[91308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b935e661-9c8b-47e7-9e74-dad6a0218ae4 1073741824 Apr 24 13:59:17 devstack sudo[91308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:17 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-659d5ae3-2fb6-4fac-80a0-1debcdb1fe00 tempest-SnapshotDependencyTests-704110802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb8a5597-0aa4-434b-b837-eeb6bd7c53fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:17 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-659d5ae3-2fb6-4fac-80a0-1debcdb1fe00 tempest-SnapshotDependencyTests-704110802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (374cb6d0-4a34-45e8-b0d0-155fec64e364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:17 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-659d5ae3-2fb6-4fac-80a0-1debcdb1fe00 tempest-SnapshotDependencyTests-704110802 None] Volume volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7 (75233b5d-1a06-4fcc-a057-5d525e7af8e7): created successfully Apr 24 13:59:17 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-659d5ae3-2fb6-4fac-80a0-1debcdb1fe00 tempest-SnapshotDependencyTests-704110802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (374cb6d0-4a34-45e8-b0d0-155fec64e364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:17 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-659d5ae3-2fb6-4fac-80a0-1debcdb1fe00 tempest-SnapshotDependencyTests-704110802 None] Flow 'volume_create_manager' (0df47fc0-edb9-4fd0-96c0-fbb1f755405c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:59:17 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-659d5ae3-2fb6-4fac-80a0-1debcdb1fe00 tempest-SnapshotDependencyTests-704110802 None] Created volume successfully. Apr 24 13:59:18 devstack sudo[91305]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:18 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-54f06c48-9cb5-49e9-89de-473fd268fc9c tempest-CreateVolumesFromSnapshotTest-323228305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-db0155c8-287f-4c1d-89d4-50499ce19c83" returned: 0 in 0.549s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:18 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-54f06c48-9cb5-49e9-89de-473fd268fc9c tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "cinder-quobyte-db0155c8-287f-4c1d-89d4-50499ce19c83" released by "delete_volume" :: held 1.225s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:59:18 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-54f06c48-9cb5-49e9-89de-473fd268fc9c tempest-CreateVolumesFromSnapshotTest-323228305 None] Created reservations ['63ae8151-6ae7-4905-915a-b972e73d7ca7', '580c0fa5-f6ba-4167-8327-0cbbcf2f1af6', 'dfa93123-2612-46e5-b8a8-86359d2b9ea4', '24c917da-91d0-450e-af21-a6da0e2e5a96'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:59:18 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-54f06c48-9cb5-49e9-89de-473fd268fc9c tempest-CreateVolumesFromSnapshotTest-323228305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:59:18 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-54f06c48-9cb5-49e9-89de-473fd268fc9c tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:59:18 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-54f06c48-9cb5-49e9-89de-473fd268fc9c tempest-CreateVolumesFromSnapshotTest-323228305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:59:18 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-54f06c48-9cb5-49e9-89de-473fd268fc9c tempest-CreateVolumesFromSnapshotTest-323228305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:59:18 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-54f06c48-9cb5-49e9-89de-473fd268fc9c tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:59:18 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-54f06c48-9cb5-49e9-89de-473fd268fc9c tempest-CreateVolumesFromSnapshotTest-323228305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:18 devstack sudo[91314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:59:18 devstack sudo[91314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:18 devstack sudo[91308]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:18 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-269dbfb3-54d0-4df9-a952-96eab199c926 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b935e661-9c8b-47e7-9e74-dad6a0218ae4 1073741824" returned: 0 in 0.777s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:18 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-269dbfb3-54d0-4df9-a952-96eab199c926 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b935e661-9c8b-47e7-9e74-dad6a0218ae4 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:18 devstack sudo[91316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b935e661-9c8b-47e7-9e74-dad6a0218ae4 Apr 24 13:59:18 devstack sudo[91316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:18 devstack sudo[91314]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:18 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-54f06c48-9cb5-49e9-89de-473fd268fc9c tempest-CreateVolumesFromSnapshotTest-323228305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.516s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:18 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-54f06c48-9cb5-49e9-89de-473fd268fc9c tempest-CreateVolumesFromSnapshotTest-323228305 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:59:18 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-54f06c48-9cb5-49e9-89de-473fd268fc9c tempest-CreateVolumesFromSnapshotTest-323228305 None] Deleted volume successfully. Apr 24 13:59:18 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-54f06c48-9cb5-49e9-89de-473fd268fc9c tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "cinder-db0155c8-287f-4c1d-89d4-50499ce19c83-delete_volume" released by "delete_volume" :: held 2.015s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:59:19 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-146a9d72-d8d2-4147-9a14-c8ccd14fedee tempest-CreateVolumesFromSnapshotTest-323228305 None] Acquiring lock "cinder-589112d4-be7e-4f53-9218-65c0dfbc1ec1-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:59:19 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-146a9d72-d8d2-4147-9a14-c8ccd14fedee tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "cinder-589112d4-be7e-4f53-9218-65c0dfbc1ec1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:59:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-47ebb98a-871f-4d31-a647-065bca19ce9e tempest-SnapshotDependencyTests-704110802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:59:19 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-146a9d72-d8d2-4147-9a14-c8ccd14fedee tempest-CreateVolumesFromSnapshotTest-323228305 None] Acquiring lock "cinder-quobyte-589112d4-be7e-4f53-9218-65c0dfbc1ec1" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:59:19 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-146a9d72-d8d2-4147-9a14-c8ccd14fedee tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "cinder-quobyte-589112d4-be7e-4f53-9218-65c0dfbc1ec1" acquired by "delete_volume" :: waited 0.018s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:59:19 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d42a74-b276-41b7-bf27-e770044efea0]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:59:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-146a9d72-d8d2-4147-9a14-c8ccd14fedee tempest-CreateVolumesFromSnapshotTest-323228305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-589112d4-be7e-4f53-9218-65c0dfbc1ec1 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:19 devstack sudo[91316]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-269dbfb3-54d0-4df9-a952-96eab199c926 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b935e661-9c8b-47e7-9e74-dad6a0218ae4" returned: 0 in 0.626s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:19 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-269dbfb3-54d0-4df9-a952-96eab199c926 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] <== create_volume: return (1453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:59:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-269dbfb3-54d0-4df9-a952-96eab199c926 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:59:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-aad88c89-fe63-4fb3-b779-084e755a6ccb tempest-VolumeDependencyTests-1150031044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.994s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:59:19 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-aad88c89-fe63-4fb3-b779-084e755a6ccb tempest-VolumeDependencyTests-1150031044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:59:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2003640364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4e024a8-e590-4058-8266-9f96b0d66f4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f005df8063f146e6a7771f312188d27b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:59:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:59:16Z,use_quota=True,user_id='f8c84f24edbc491cab1205885eab34d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:59:19 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-aad88c89-fe63-4fb3-b779-084e755a6ccb tempest-VolumeDependencyTests-1150031044 None] Creating volume f4e024a8-e590-4058-8266-9f96b0d66f4e {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:59:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-aad88c89-fe63-4fb3-b779-084e755a6ccb tempest-VolumeDependencyTests-1150031044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:59:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-aad88c89-fe63-4fb3-b779-084e755a6ccb tempest-VolumeDependencyTests-1150031044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:59:19 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-aad88c89-fe63-4fb3-b779-084e755a6ccb tempest-VolumeDependencyTests-1150031044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:59:19 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-aad88c89-fe63-4fb3-b779-084e755a6ccb tempest-VolumeDependencyTests-1150031044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:59:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-aad88c89-fe63-4fb3-b779-084e755a6ccb tempest-VolumeDependencyTests-1150031044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:59:19 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-aad88c89-fe63-4fb3-b779-084e755a6ccb tempest-VolumeDependencyTests-1150031044 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:59:19 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-aad88c89-fe63-4fb3-b779-084e755a6ccb tempest-VolumeDependencyTests-1150031044 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:59:19 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-aad88c89-fe63-4fb3-b779-084e755a6ccb tempest-VolumeDependencyTests-1150031044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:19 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-269dbfb3-54d0-4df9-a952-96eab199c926 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83879c7a-e34b-494b-b71e-3d87b12854a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b935e661-9c8b-47e7-9e74-dad6a0218ae4', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:19 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-269dbfb3-54d0-4df9-a952-96eab199c926 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6df7bfda-eab5-4cce-8213-9616efa59ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:19 devstack sudo[91352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-589112d4-be7e-4f53-9218-65c0dfbc1ec1 Apr 24 13:59:19 devstack sudo[91352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:19 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-269dbfb3-54d0-4df9-a952-96eab199c926 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Volume volume-b935e661-9c8b-47e7-9e74-dad6a0218ae4 (b935e661-9c8b-47e7-9e74-dad6a0218ae4): created successfully Apr 24 13:59:19 devstack sudo[91353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e 1073741824 Apr 24 13:59:19 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-269dbfb3-54d0-4df9-a952-96eab199c926 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6df7bfda-eab5-4cce-8213-9616efa59ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:19 devstack sudo[91353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:19 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-269dbfb3-54d0-4df9-a952-96eab199c926 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Flow 'volume_create_manager' (2a2bcf3f-d9bf-4a04-868f-a7daa950e644) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:59:19 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-269dbfb3-54d0-4df9-a952-96eab199c926 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Created volume successfully. Apr 24 13:59:19 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa5901a2-ea1f-44e0-a7a9-a7c5409ca03a tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:59:19 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aa5901a2-ea1f-44e0-a7a9-a7c5409ca03a tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Flow 'volume_create_manager' (f43c47ee-74d2-49c6-ae64-d6b37baa8660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:59:19 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aa5901a2-ea1f-44e0-a7a9-a7c5409ca03a tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (713f016d-8c57-43ef-8aba-c2bf8886fe3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:19 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aa5901a2-ea1f-44e0-a7a9-a7c5409ca03a tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (713f016d-8c57-43ef-8aba-c2bf8886fe3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1950150006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45dd4b7b-670d-40b0-9c60-34fbc34a408f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='615d789bb4dd4a3ca71c1ec449f20ba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:59:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:59:20Z,use_quota=True,user_id='542d00693e2741a1bb7698649b0d9b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:19 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aa5901a2-ea1f-44e0-a7a9-a7c5409ca03a tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74e37a12-ab6e-472f-9175-bdc78c528270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:19 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aa5901a2-ea1f-44e0-a7a9-a7c5409ca03a tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74e37a12-ab6e-472f-9175-bdc78c528270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:20 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aa5901a2-ea1f-44e0-a7a9-a7c5409ca03a tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5974854e-b813-429f-90fd-dc5de0f6551d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:20 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aa5901a2-ea1f-44e0-a7a9-a7c5409ca03a tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5974854e-b813-429f-90fd-dc5de0f6551d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45dd4b7b-670d-40b0-9c60-34fbc34a408f', 'volume_name': 'volume-45dd4b7b-670d-40b0-9c60-34fbc34a408f', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:20 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aa5901a2-ea1f-44e0-a7a9-a7c5409ca03a tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (059f17d3-d90b-492e-b3b1-0186ed8d07e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:20 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aa5901a2-ea1f-44e0-a7a9-a7c5409ca03a tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (059f17d3-d90b-492e-b3b1-0186ed8d07e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:20 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aa5901a2-ea1f-44e0-a7a9-a7c5409ca03a tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8076400-b658-45d0-b0c8-5fa109dc8d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:20 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-aa5901a2-ea1f-44e0-a7a9-a7c5409ca03a tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Volume 45dd4b7b-670d-40b0-9c60-34fbc34a408f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45dd4b7b-670d-40b0-9c60-34fbc34a408f', 'volume_size': 1} Apr 24 13:59:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-aa5901a2-ea1f-44e0-a7a9-a7c5409ca03a tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:59:20 devstack sudo[91352]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-146a9d72-d8d2-4147-9a14-c8ccd14fedee tempest-CreateVolumesFromSnapshotTest-323228305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-589112d4-be7e-4f53-9218-65c0dfbc1ec1" returned: 0 in 0.743s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-146a9d72-d8d2-4147-9a14-c8ccd14fedee tempest-CreateVolumesFromSnapshotTest-323228305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-589112d4-be7e-4f53-9218-65c0dfbc1ec1 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:20 devstack sudo[91364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-589112d4-be7e-4f53-9218-65c0dfbc1ec1 Apr 24 13:59:20 devstack sudo[91364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:20 devstack sudo[91353]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:20 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-9419156e-01e2-4b24-bfd2-96b944bd26e7 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:59:20 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-9419156e-01e2-4b24-bfd2-96b944bd26e7 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Flow 'volume_create_manager' (2bc055fa-6cec-4ed5-a3d2-b72df028aa8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:59:20 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-9419156e-01e2-4b24-bfd2-96b944bd26e7 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f70aaf1b-5454-4ba6-898d-aa356c50bb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-aad88c89-fe63-4fb3-b779-084e755a6ccb tempest-VolumeDependencyTests-1150031044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e 1073741824" returned: 0 in 1.026s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:20 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-9419156e-01e2-4b24-bfd2-96b944bd26e7 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f70aaf1b-5454-4ba6-898d-aa356c50bb30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-226262675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0473307-912b-4b03-9ec8-2b42279c01a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='615d789bb4dd4a3ca71c1ec449f20ba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:59:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:59:20Z,use_quota=True,user_id='542d00693e2741a1bb7698649b0d9b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:20 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-9419156e-01e2-4b24-bfd2-96b944bd26e7 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4deeb9df-5338-4b8a-9294-a09938ef0234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:20 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-9419156e-01e2-4b24-bfd2-96b944bd26e7 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4deeb9df-5338-4b8a-9294-a09938ef0234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:20 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-9419156e-01e2-4b24-bfd2-96b944bd26e7 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bad438a6-a0be-4045-a7a1-7bdcf508d56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:20 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-9419156e-01e2-4b24-bfd2-96b944bd26e7 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bad438a6-a0be-4045-a7a1-7bdcf508d56f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0473307-912b-4b03-9ec8-2b42279c01a9', 'volume_name': 'volume-a0473307-912b-4b03-9ec8-2b42279c01a9', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:20 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-9419156e-01e2-4b24-bfd2-96b944bd26e7 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c046b749-1a05-4ec0-ba58-7c7e9e3df82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:20 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-9419156e-01e2-4b24-bfd2-96b944bd26e7 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c046b749-1a05-4ec0-ba58-7c7e9e3df82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:20 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-9419156e-01e2-4b24-bfd2-96b944bd26e7 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (282f738f-e576-43ac-aa52-7812014e9be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:20 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-9419156e-01e2-4b24-bfd2-96b944bd26e7 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Volume a0473307-912b-4b03-9ec8-2b42279c01a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0473307-912b-4b03-9ec8-2b42279c01a9', 'volume_size': 1} Apr 24 13:59:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-9419156e-01e2-4b24-bfd2-96b944bd26e7 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:59:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-aad88c89-fe63-4fb3-b779-084e755a6ccb tempest-VolumeDependencyTests-1150031044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:20 devstack sudo[91366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e Apr 24 13:59:20 devstack sudo[91366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:20 devstack sudo[91364]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-146a9d72-d8d2-4147-9a14-c8ccd14fedee tempest-CreateVolumesFromSnapshotTest-323228305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-589112d4-be7e-4f53-9218-65c0dfbc1ec1" returned: 0 in 0.739s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:20 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-146a9d72-d8d2-4147-9a14-c8ccd14fedee tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "cinder-quobyte-589112d4-be7e-4f53-9218-65c0dfbc1ec1" released by "delete_volume" :: held 1.555s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:59:20 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4753349-3be7-47ff-9478-5205d4864739 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:59:20 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b4753349-3be7-47ff-9478-5205d4864739 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Flow 'volume_create_manager' (9a928594-34ed-454d-bfe4-33534a4ea8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:59:20 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b4753349-3be7-47ff-9478-5205d4864739 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca38d506-d1a6-4e9f-a9c2-b4696c2ed4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:20 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b4753349-3be7-47ff-9478-5205d4864739 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca38d506-d1a6-4e9f-a9c2-b4696c2ed4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-91070933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57a2fd03-e864-49ee-be7a-154ab16f999e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='615d789bb4dd4a3ca71c1ec449f20ba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:59:21Z,use_quota=True,user_id='542d00693e2741a1bb7698649b0d9b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:20 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b4753349-3be7-47ff-9478-5205d4864739 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (523f5fe9-a810-4402-8b1e-2a07da215d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:20 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b4753349-3be7-47ff-9478-5205d4864739 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (523f5fe9-a810-4402-8b1e-2a07da215d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:20 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b4753349-3be7-47ff-9478-5205d4864739 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a25fa082-4a76-42b8-96c2-ec705e17ce2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:20 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b4753349-3be7-47ff-9478-5205d4864739 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a25fa082-4a76-42b8-96c2-ec705e17ce2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57a2fd03-e864-49ee-be7a-154ab16f999e', 'volume_name': 'volume-57a2fd03-e864-49ee-be7a-154ab16f999e', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:20 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b4753349-3be7-47ff-9478-5205d4864739 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (617bd2d7-3451-4828-b0ad-80f17c4bcc9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:20 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b4753349-3be7-47ff-9478-5205d4864739 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (617bd2d7-3451-4828-b0ad-80f17c4bcc9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:20 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b4753349-3be7-47ff-9478-5205d4864739 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8edae0d7-7eac-487e-8cac-14ae70eedbaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:20 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-b4753349-3be7-47ff-9478-5205d4864739 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Volume 57a2fd03-e864-49ee-be7a-154ab16f999e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57a2fd03-e864-49ee-be7a-154ab16f999e', 'volume_size': 1} Apr 24 13:59:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b4753349-3be7-47ff-9478-5205d4864739 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:59:20 devstack sudo[91366]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-aad88c89-fe63-4fb3-b779-084e755a6ccb tempest-VolumeDependencyTests-1150031044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e" returned: 0 in 0.533s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:20 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-aad88c89-fe63-4fb3-b779-084e755a6ccb tempest-VolumeDependencyTests-1150031044 None] <== create_volume: return (1643ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:59:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-aad88c89-fe63-4fb3-b779-084e755a6ccb tempest-VolumeDependencyTests-1150031044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.646s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:59:20 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-47ebb98a-871f-4d31-a647-065bca19ce9e tempest-SnapshotDependencyTests-704110802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.734s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:59:20 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-47ebb98a-871f-4d31-a647-065bca19ce9e tempest-SnapshotDependencyTests-704110802 None] Creating offline snapshot 1a1aaeec-46a1-4fba-a1e2-8216ddcd4583 of volume 75233b5d-1a06-4fcc-a057-5d525e7af8e7 {{(pid=82046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 13:59:21 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea9ec08-7d64-47b5-8cfb-e9c07753c3a8]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:59:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-47ebb98a-871f-4d31-a647-065bca19ce9e tempest-SnapshotDependencyTests-704110802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:21 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aad88c89-fe63-4fb3-b779-084e755a6ccb tempest-VolumeDependencyTests-1150031044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edd6b8cb-e599-4ac7-a08a-e721df212a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4e024a8-e590-4058-8266-9f96b0d66f4e', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:21 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aad88c89-fe63-4fb3-b779-084e755a6ccb tempest-VolumeDependencyTests-1150031044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0da20c9b-8dc3-4850-be69-d25690f1f350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:21 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-146a9d72-d8d2-4147-9a14-c8ccd14fedee tempest-CreateVolumesFromSnapshotTest-323228305 None] Created reservations ['3557d4ca-9311-4866-87b2-ad85a3df0277', '772876e4-6dc2-4250-ae45-41201286a602', '836c0408-4122-4674-911a-eeab18bd714c', '0e962bfb-e795-4fa9-886f-6c60e69e18dc'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:59:21 devstack sudo[91370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7 Apr 24 13:59:21 devstack sudo[91370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:21 devstack sudo[91370]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-47ebb98a-871f-4d31-a647-065bca19ce9e tempest-SnapshotDependencyTests-704110802 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7" returned: 0 in 0.612s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:21 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-47ebb98a-871f-4d31-a647-065bca19ce9e tempest-SnapshotDependencyTests-704110802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7.1a1aaeec-46a1-4fba-a1e2-8216ddcd4583 1G {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:21 devstack sudo[91375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7.1a1aaeec-46a1-4fba-a1e2-8216ddcd4583 1G Apr 24 13:59:21 devstack sudo[91375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:21 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-aad88c89-fe63-4fb3-b779-084e755a6ccb tempest-VolumeDependencyTests-1150031044 None] Volume volume-f4e024a8-e590-4058-8266-9f96b0d66f4e (f4e024a8-e590-4058-8266-9f96b0d66f4e): created successfully Apr 24 13:59:21 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aad88c89-fe63-4fb3-b779-084e755a6ccb tempest-VolumeDependencyTests-1150031044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0da20c9b-8dc3-4850-be69-d25690f1f350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:21 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aad88c89-fe63-4fb3-b779-084e755a6ccb tempest-VolumeDependencyTests-1150031044 None] Flow 'volume_create_manager' (770addf9-537d-4606-98df-413422612d9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:59:22 devstack sudo[91375]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-47ebb98a-871f-4d31-a647-065bca19ce9e tempest-SnapshotDependencyTests-704110802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7.1a1aaeec-46a1-4fba-a1e2-8216ddcd4583 1G" returned: 0 in 0.666s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-47ebb98a-871f-4d31-a647-065bca19ce9e tempest-SnapshotDependencyTests-704110802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7.1a1aaeec-46a1-4fba-a1e2-8216ddcd4583 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:22 devstack sudo[91380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7.1a1aaeec-46a1-4fba-a1e2-8216ddcd4583 Apr 24 13:59:22 devstack sudo[91380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:22 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-aad88c89-fe63-4fb3-b779-084e755a6ccb tempest-VolumeDependencyTests-1150031044 None] Created volume successfully. Apr 24 13:59:22 devstack sudo[91380]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-47ebb98a-871f-4d31-a647-065bca19ce9e tempest-SnapshotDependencyTests-704110802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7.1a1aaeec-46a1-4fba-a1e2-8216ddcd4583" returned: 0 in 0.539s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:22 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-47ebb98a-871f-4d31-a647-065bca19ce9e tempest-SnapshotDependencyTests-704110802 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7.1a1aaeec-46a1-4fba-a1e2-8216ddcd4583 is being set with open permissions: ugo+rw Apr 24 13:59:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-47ebb98a-871f-4d31-a647-065bca19ce9e tempest-SnapshotDependencyTests-704110802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7.1a1aaeec-46a1-4fba-a1e2-8216ddcd4583 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:22 devstack sudo[91385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7.1a1aaeec-46a1-4fba-a1e2-8216ddcd4583 Apr 24 13:59:22 devstack sudo[91385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:22 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-146a9d72-d8d2-4147-9a14-c8ccd14fedee tempest-CreateVolumesFromSnapshotTest-323228305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:59:23 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-146a9d72-d8d2-4147-9a14-c8ccd14fedee tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:59:23 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-146a9d72-d8d2-4147-9a14-c8ccd14fedee tempest-CreateVolumesFromSnapshotTest-323228305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:59:23 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-146a9d72-d8d2-4147-9a14-c8ccd14fedee tempest-CreateVolumesFromSnapshotTest-323228305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:59:23 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-146a9d72-d8d2-4147-9a14-c8ccd14fedee tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:59:23 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-146a9d72-d8d2-4147-9a14-c8ccd14fedee tempest-CreateVolumesFromSnapshotTest-323228305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:23 devstack sudo[91387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:59:23 devstack sudo[91387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:23 devstack sudo[91385]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:23 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-47ebb98a-871f-4d31-a647-065bca19ce9e tempest-SnapshotDependencyTests-704110802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7.1a1aaeec-46a1-4fba-a1e2-8216ddcd4583" returned: 0 in 0.472s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:23 devstack sudo[91387]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:23 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-146a9d72-d8d2-4147-9a14-c8ccd14fedee tempest-CreateVolumesFromSnapshotTest-323228305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.496s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:23 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-146a9d72-d8d2-4147-9a14-c8ccd14fedee tempest-CreateVolumesFromSnapshotTest-323228305 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:59:23 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-146a9d72-d8d2-4147-9a14-c8ccd14fedee tempest-CreateVolumesFromSnapshotTest-323228305 None] Deleted volume successfully. Apr 24 13:59:25 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-47ebb98a-871f-4d31-a647-065bca19ce9e tempest-SnapshotDependencyTests-704110802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:25 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d036541-07eb-46f7-b752-ab39a841bbc6 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:59:25 devstack sudo[91392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7.info Apr 24 13:59:25 devstack sudo[91392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:25 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4d036541-07eb-46f7-b752-ab39a841bbc6 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Flow 'volume_create_manager' (4f8cbbe6-c072-4650-a53e-cf5d103e543e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:59:25 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4d036541-07eb-46f7-b752-ab39a841bbc6 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfb64a99-8498-48c7-818c-0cd573109bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:25 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-146a9d72-d8d2-4147-9a14-c8ccd14fedee tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "cinder-589112d4-be7e-4f53-9218-65c0dfbc1ec1-delete_volume" released by "delete_volume" :: held 6.720s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:59:25 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4d036541-07eb-46f7-b752-ab39a841bbc6 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfb64a99-8498-48c7-818c-0cd573109bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-34070757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6977af4-1428-413d-ad20-ebc1e469abe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='615d789bb4dd4a3ca71c1ec449f20ba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:59:22Z,use_quota=True,user_id='542d00693e2741a1bb7698649b0d9b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:25 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4d036541-07eb-46f7-b752-ab39a841bbc6 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6953365-20fa-4f34-8115-7486f3fe7b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:25 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4d036541-07eb-46f7-b752-ab39a841bbc6 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6953365-20fa-4f34-8115-7486f3fe7b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:25 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4d036541-07eb-46f7-b752-ab39a841bbc6 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8c1f45a-f831-4d8d-9cd2-00f3fca49d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:25 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4d036541-07eb-46f7-b752-ab39a841bbc6 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8c1f45a-f831-4d8d-9cd2-00f3fca49d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6977af4-1428-413d-ad20-ebc1e469abe9', 'volume_name': 'volume-e6977af4-1428-413d-ad20-ebc1e469abe9', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:25 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4d036541-07eb-46f7-b752-ab39a841bbc6 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2bb9c21-2258-40ff-bdbd-61b5aa1c64da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:25 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4d036541-07eb-46f7-b752-ab39a841bbc6 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2bb9c21-2258-40ff-bdbd-61b5aa1c64da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:25 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4d036541-07eb-46f7-b752-ab39a841bbc6 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97e73c1a-c42c-498a-aa3d-480f229b35bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:25 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-4d036541-07eb-46f7-b752-ab39a841bbc6 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Volume e6977af4-1428-413d-ad20-ebc1e469abe9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6977af4-1428-413d-ad20-ebc1e469abe9', 'volume_size': 1} Apr 24 13:59:25 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4d036541-07eb-46f7-b752-ab39a841bbc6 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:59:26 devstack sudo[91392]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-47ebb98a-871f-4d31-a647-065bca19ce9e tempest-SnapshotDependencyTests-704110802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7.info" returned: 0 in 0.444s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:26 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-47ebb98a-871f-4d31-a647-065bca19ce9e tempest-SnapshotDependencyTests-704110802 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7.info is being set with open permissions: ugo+rw Apr 24 13:59:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-47ebb98a-871f-4d31-a647-065bca19ce9e tempest-SnapshotDependencyTests-704110802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:26 devstack sudo[91395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7.info Apr 24 13:59:26 devstack sudo[91395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:26 devstack sudo[91395]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-47ebb98a-871f-4d31-a647-065bca19ce9e tempest-SnapshotDependencyTests-704110802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7.info" returned: 0 in 0.432s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-47ebb98a-871f-4d31-a647-065bca19ce9e tempest-SnapshotDependencyTests-704110802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.768s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:59:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-aa5901a2-ea1f-44e0-a7a9-a7c5409ca03a tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.721s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:59:26 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-aa5901a2-ea1f-44e0-a7a9-a7c5409ca03a tempest-CreateVolumesFromSourceVolumeTest-103316046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1950150006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45dd4b7b-670d-40b0-9c60-34fbc34a408f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='615d789bb4dd4a3ca71c1ec449f20ba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:59:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:59:20Z,use_quota=True,user_id='542d00693e2741a1bb7698649b0d9b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:59:26 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-aa5901a2-ea1f-44e0-a7a9-a7c5409ca03a tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Creating volume 45dd4b7b-670d-40b0-9c60-34fbc34a408f {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:59:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-aa5901a2-ea1f-44e0-a7a9-a7c5409ca03a tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:59:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-aa5901a2-ea1f-44e0-a7a9-a7c5409ca03a tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:59:26 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-aa5901a2-ea1f-44e0-a7a9-a7c5409ca03a tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:59:26 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-aa5901a2-ea1f-44e0-a7a9-a7c5409ca03a tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:59:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-aa5901a2-ea1f-44e0-a7a9-a7c5409ca03a tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:59:26 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-aa5901a2-ea1f-44e0-a7a9-a7c5409ca03a tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:59:26 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-aa5901a2-ea1f-44e0-a7a9-a7c5409ca03a tempest-CreateVolumesFromSourceVolumeTest-103316046 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:59:26 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-aa5901a2-ea1f-44e0-a7a9-a7c5409ca03a tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-45dd4b7b-670d-40b0-9c60-34fbc34a408f 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:26 devstack sudo[91398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-45dd4b7b-670d-40b0-9c60-34fbc34a408f 1073741824 Apr 24 13:59:26 devstack sudo[91398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:27 devstack sudo[91398]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:27 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-aa5901a2-ea1f-44e0-a7a9-a7c5409ca03a tempest-CreateVolumesFromSourceVolumeTest-103316046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-45dd4b7b-670d-40b0-9c60-34fbc34a408f 1073741824" returned: 0 in 0.673s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:27 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-94f2c21f-dd34-4e62-bf55-cfe7b353214c tempest-CreateVolumesFromSnapshotTest-323228305 None] Acquiring lock "cinder-a9254918-44ae-4b5a-ab69-0a9ef551f0f0-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:59:27 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-94f2c21f-dd34-4e62-bf55-cfe7b353214c tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "cinder-a9254918-44ae-4b5a-ab69-0a9ef551f0f0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:59:28 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-47ebb98a-871f-4d31-a647-065bca19ce9e tempest-SnapshotDependencyTests-704110802 None] Create snapshot completed successfully Apr 24 13:59:28 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-94f2c21f-dd34-4e62-bf55-cfe7b353214c tempest-CreateVolumesFromSnapshotTest-323228305 None] Acquiring lock "cinder-quobyte-a9254918-44ae-4b5a-ab69-0a9ef551f0f0" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:59:28 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-94f2c21f-dd34-4e62-bf55-cfe7b353214c tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "cinder-quobyte-a9254918-44ae-4b5a-ab69-0a9ef551f0f0" acquired by "delete_volume" :: waited 0.022s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:59:28 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8aecf0-4df2-4100-a4de-090ddb09c5cb]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:59:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-94f2c21f-dd34-4e62-bf55-cfe7b353214c tempest-CreateVolumesFromSnapshotTest-323228305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a9254918-44ae-4b5a-ab69-0a9ef551f0f0 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-aa5901a2-ea1f-44e0-a7a9-a7c5409ca03a tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-45dd4b7b-670d-40b0-9c60-34fbc34a408f {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:28 devstack sudo[91404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-45dd4b7b-670d-40b0-9c60-34fbc34a408f Apr 24 13:59:28 devstack sudo[91404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:28 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d1bcefd-b05b-447c-a2ee-b20f19c11009 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:59:28 devstack sudo[91403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a9254918-44ae-4b5a-ab69-0a9ef551f0f0 Apr 24 13:59:28 devstack sudo[91403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-3d1bcefd-b05b-447c-a2ee-b20f19c11009 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Flow 'volume_create_manager' (f1ca348e-5428-4819-baf6-0799b8385efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:59:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-3d1bcefd-b05b-447c-a2ee-b20f19c11009 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7900b0ad-f1f9-453f-894d-d932f579c0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-3d1bcefd-b05b-447c-a2ee-b20f19c11009 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7900b0ad-f1f9-453f-894d-d932f579c0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-265060903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=468dce69-0dc2-47b8-9ee2-133bb469e887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='615d789bb4dd4a3ca71c1ec449f20ba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:59:28Z,use_quota=True,user_id='542d00693e2741a1bb7698649b0d9b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-3d1bcefd-b05b-447c-a2ee-b20f19c11009 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (443e8597-61f2-4fe5-b64d-769fc45c9836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-3d1bcefd-b05b-447c-a2ee-b20f19c11009 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (443e8597-61f2-4fe5-b64d-769fc45c9836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-3d1bcefd-b05b-447c-a2ee-b20f19c11009 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f98ad8a9-17cf-4a90-9586-8a872d20559d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-3d1bcefd-b05b-447c-a2ee-b20f19c11009 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f98ad8a9-17cf-4a90-9586-8a872d20559d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '468dce69-0dc2-47b8-9ee2-133bb469e887', 'volume_name': 'volume-468dce69-0dc2-47b8-9ee2-133bb469e887', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-3d1bcefd-b05b-447c-a2ee-b20f19c11009 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3555c61b-c980-45d1-964a-48878724ee2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-3d1bcefd-b05b-447c-a2ee-b20f19c11009 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3555c61b-c980-45d1-964a-48878724ee2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-3d1bcefd-b05b-447c-a2ee-b20f19c11009 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73a300b3-17e6-4f9d-a335-3473600234f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:28 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-3d1bcefd-b05b-447c-a2ee-b20f19c11009 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Volume 468dce69-0dc2-47b8-9ee2-133bb469e887: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-468dce69-0dc2-47b8-9ee2-133bb469e887', 'volume_size': 1} Apr 24 13:59:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-3d1bcefd-b05b-447c-a2ee-b20f19c11009 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:59:28 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:59:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Flow 'volume_create_manager' (25afa539-8589-4938-9dd7-4661febe9a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:59:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13eba44d-abd4-4cbc-9d18-d1f1c3b702a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13eba44d-abd4-4cbc-9d18-d1f1c3b702a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:59:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-548027244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f106ad93-380f-412d-9bc1-0f26cd5d6369,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f005df8063f146e6a7771f312188d27b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=f4e024a8-e590-4058-8266-9f96b0d66f4e,status='creating',terminated_at=None,updated_at=2026-04-24T11:59:28Z,use_quota=True,user_id='f8c84f24edbc491cab1205885eab34d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77881235-6336-435a-bc52-fad11f1eaee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77881235-6336-435a-bc52-fad11f1eaee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e882e2b-9d00-42db-8043-f070830255d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e882e2b-9d00-42db-8043-f070830255d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f106ad93-380f-412d-9bc1-0f26cd5d6369', 'volume_name': 'volume-f106ad93-380f-412d-9bc1-0f26cd5d6369', 'volume_size': 1, 'source_volid': 'f4e024a8-e590-4058-8266-9f96b0d66f4e', 'source_volstatus': 'available'}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ecd71a4-fb8d-43ad-a0ef-81e1f0f67536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ecd71a4-fb8d-43ad-a0ef-81e1f0f67536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95036fec-620a-409d-b2d9-f94ef16ca9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:28 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Volume f106ad93-380f-412d-9bc1-0f26cd5d6369: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f106ad93-380f-412d-9bc1-0f26cd5d6369', 'volume_size': 1, 'source_volid': 'f4e024a8-e590-4058-8266-9f96b0d66f4e', 'source_volstatus': 'available'} Apr 24 13:59:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:59:28 devstack sudo[91404]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-aa5901a2-ea1f-44e0-a7a9-a7c5409ca03a tempest-CreateVolumesFromSourceVolumeTest-103316046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-45dd4b7b-670d-40b0-9c60-34fbc34a408f" returned: 0 in 0.549s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:28 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-aa5901a2-ea1f-44e0-a7a9-a7c5409ca03a tempest-CreateVolumesFromSourceVolumeTest-103316046 None] <== create_volume: return (1953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:59:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-aa5901a2-ea1f-44e0-a7a9-a7c5409ca03a tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.957s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:59:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-9419156e-01e2-4b24-bfd2-96b944bd26e7 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.290s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:59:28 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-9419156e-01e2-4b24-bfd2-96b944bd26e7 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-226262675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0473307-912b-4b03-9ec8-2b42279c01a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='615d789bb4dd4a3ca71c1ec449f20ba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:59:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:59:20Z,use_quota=True,user_id='542d00693e2741a1bb7698649b0d9b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:59:28 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-9419156e-01e2-4b24-bfd2-96b944bd26e7 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Creating volume a0473307-912b-4b03-9ec8-2b42279c01a9 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:59:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-9419156e-01e2-4b24-bfd2-96b944bd26e7 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:59:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-9419156e-01e2-4b24-bfd2-96b944bd26e7 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:59:28 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-9419156e-01e2-4b24-bfd2-96b944bd26e7 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:59:28 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-9419156e-01e2-4b24-bfd2-96b944bd26e7 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:59:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-9419156e-01e2-4b24-bfd2-96b944bd26e7 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:59:28 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-9419156e-01e2-4b24-bfd2-96b944bd26e7 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:59:28 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-9419156e-01e2-4b24-bfd2-96b944bd26e7 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:59:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-9419156e-01e2-4b24-bfd2-96b944bd26e7 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a0473307-912b-4b03-9ec8-2b42279c01a9 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:28 devstack sudo[91408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a0473307-912b-4b03-9ec8-2b42279c01a9 1073741824 Apr 24 13:59:28 devstack sudo[91408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aa5901a2-ea1f-44e0-a7a9-a7c5409ca03a tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8076400-b658-45d0-b0c8-5fa109dc8d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45dd4b7b-670d-40b0-9c60-34fbc34a408f', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aa5901a2-ea1f-44e0-a7a9-a7c5409ca03a tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee32aaca-6664-4d02-a546-fb99cb27bebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:28 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-aa5901a2-ea1f-44e0-a7a9-a7c5409ca03a tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Volume volume-45dd4b7b-670d-40b0-9c60-34fbc34a408f (45dd4b7b-670d-40b0-9c60-34fbc34a408f): created successfully Apr 24 13:59:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aa5901a2-ea1f-44e0-a7a9-a7c5409ca03a tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee32aaca-6664-4d02-a546-fb99cb27bebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:28 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-aa5901a2-ea1f-44e0-a7a9-a7c5409ca03a tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Flow 'volume_create_manager' (f43c47ee-74d2-49c6-ae64-d6b37baa8660) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:59:28 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-aa5901a2-ea1f-44e0-a7a9-a7c5409ca03a tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Created volume successfully. Apr 24 13:59:28 devstack sudo[91403]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-94f2c21f-dd34-4e62-bf55-cfe7b353214c tempest-CreateVolumesFromSnapshotTest-323228305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a9254918-44ae-4b5a-ab69-0a9ef551f0f0" returned: 0 in 0.769s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:28 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-94f2c21f-dd34-4e62-bf55-cfe7b353214c tempest-CreateVolumesFromSnapshotTest-323228305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a9254918-44ae-4b5a-ab69-0a9ef551f0f0 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:28 devstack sudo[91413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a9254918-44ae-4b5a-ab69-0a9ef551f0f0 Apr 24 13:59:28 devstack sudo[91413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:29 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:59:29 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] Flow 'volume_create_manager' (f57ec908-8fa0-458c-b8a2-8e57bc59efbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:59:29 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e330360a-e722-4cd6-bdf2-b449bd10edd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:29 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e330360a-e722-4cd6-bdf2-b449bd10edd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:59:29Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8473e3c-7ac0-494d-8edf-a97c0f45342d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db0c4204125245cd8aa3c63bed45e0c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:59:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1a1aaeec-46a1-4fba-a1e2-8216ddcd4583,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:59:29Z,use_quota=True,user_id='65f6ee0b59b4450286a28ab9485c3bd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:29 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca7b325f-cc8b-4fe8-ac29-3acdfbf81cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:29 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca7b325f-cc8b-4fe8-ac29-3acdfbf81cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:29 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e82d963-f9bd-4f59-b603-5a3f292ce329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:29 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e82d963-f9bd-4f59-b603-5a3f292ce329) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e8473e3c-7ac0-494d-8edf-a97c0f45342d', 'volume_name': 'volume-e8473e3c-7ac0-494d-8edf-a97c0f45342d', 'volume_size': 1, 'snapshot_id': '1a1aaeec-46a1-4fba-a1e2-8216ddcd4583'}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:29 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a495f35f-4839-4d6a-9d96-79505d55a6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:29 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a495f35f-4839-4d6a-9d96-79505d55a6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:29 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3abc3224-0880-4937-980d-baebc153f9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:29 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] Volume e8473e3c-7ac0-494d-8edf-a97c0f45342d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e8473e3c-7ac0-494d-8edf-a97c0f45342d', 'volume_size': 1, 'snapshot_id': '1a1aaeec-46a1-4fba-a1e2-8216ddcd4583'} Apr 24 13:59:29 devstack sudo[91413]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-94f2c21f-dd34-4e62-bf55-cfe7b353214c tempest-CreateVolumesFromSnapshotTest-323228305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a9254918-44ae-4b5a-ab69-0a9ef551f0f0" returned: 0 in 0.651s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:59:29 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-94f2c21f-dd34-4e62-bf55-cfe7b353214c tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "cinder-quobyte-a9254918-44ae-4b5a-ab69-0a9ef551f0f0" released by "delete_volume" :: held 1.475s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:59:29 devstack sudo[91408]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-9419156e-01e2-4b24-bfd2-96b944bd26e7 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a0473307-912b-4b03-9ec8-2b42279c01a9 1073741824" returned: 0 in 0.886s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:29 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-94f2c21f-dd34-4e62-bf55-cfe7b353214c tempest-CreateVolumesFromSnapshotTest-323228305 None] Created reservations ['f48f9b9d-5c6f-481a-8980-f6b9c7df8e46', 'dbf08c1b-f0c2-4b73-bdb5-e9c2bf6c2b62', '9c356bea-62a4-4c2f-948f-bf7367081c51', 'f618a795-fe00-44bf-9dee-d3f5d868c7ba'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:59:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-9419156e-01e2-4b24-bfd2-96b944bd26e7 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a0473307-912b-4b03-9ec8-2b42279c01a9 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:29 devstack sudo[91419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a0473307-912b-4b03-9ec8-2b42279c01a9 Apr 24 13:59:29 devstack sudo[91419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-94f2c21f-dd34-4e62-bf55-cfe7b353214c tempest-CreateVolumesFromSnapshotTest-323228305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:59:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-94f2c21f-dd34-4e62-bf55-cfe7b353214c tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:59:29 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-94f2c21f-dd34-4e62-bf55-cfe7b353214c tempest-CreateVolumesFromSnapshotTest-323228305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:59:29 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-94f2c21f-dd34-4e62-bf55-cfe7b353214c tempest-CreateVolumesFromSnapshotTest-323228305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:59:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-94f2c21f-dd34-4e62-bf55-cfe7b353214c tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:59:29 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-94f2c21f-dd34-4e62-bf55-cfe7b353214c tempest-CreateVolumesFromSnapshotTest-323228305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:29 devstack sudo[91421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:59:29 devstack sudo[91421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:30 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-3c7472bf-6fb2-4b56-959f-4af10d57f6c5 tempest-CreateVolumesFromSnapshotTest-323228305 None] Acquiring lock "cinder-db9096a6-e914-4b96-87e3-9271d466c3ad-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:59:30 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-3c7472bf-6fb2-4b56-959f-4af10d57f6c5 tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "cinder-db9096a6-e914-4b96-87e3-9271d466c3ad-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:59:30 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-3c7472bf-6fb2-4b56-959f-4af10d57f6c5 tempest-CreateVolumesFromSnapshotTest-323228305 None] Acquiring lock "cinder-quobyte-db9096a6-e914-4b96-87e3-9271d466c3ad" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:59:30 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-3c7472bf-6fb2-4b56-959f-4af10d57f6c5 tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "cinder-quobyte-db9096a6-e914-4b96-87e3-9271d466c3ad" acquired by "delete_volume" :: waited 0.021s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:59:30 devstack sudo[91419]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-9419156e-01e2-4b24-bfd2-96b944bd26e7 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a0473307-912b-4b03-9ec8-2b42279c01a9" returned: 0 in 0.493s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:30 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-9419156e-01e2-4b24-bfd2-96b944bd26e7 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] <== create_volume: return (1447ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:59:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-9419156e-01e2-4b24-bfd2-96b944bd26e7 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.449s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:59:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b4753349-3be7-47ff-9478-5205d4864739 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.203s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:59:30 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b4753349-3be7-47ff-9478-5205d4864739 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-91070933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57a2fd03-e864-49ee-be7a-154ab16f999e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='615d789bb4dd4a3ca71c1ec449f20ba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:59:21Z,use_quota=True,user_id='542d00693e2741a1bb7698649b0d9b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:59:30 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-b4753349-3be7-47ff-9478-5205d4864739 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Creating volume 57a2fd03-e864-49ee-be7a-154ab16f999e {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:59:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b4753349-3be7-47ff-9478-5205d4864739 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:59:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b4753349-3be7-47ff-9478-5205d4864739 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:59:30 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b4753349-3be7-47ff-9478-5205d4864739 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:59:30 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b4753349-3be7-47ff-9478-5205d4864739 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:59:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b4753349-3be7-47ff-9478-5205d4864739 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:59:30 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b4753349-3be7-47ff-9478-5205d4864739 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:59:30 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-b4753349-3be7-47ff-9478-5205d4864739 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:59:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b4753349-3be7-47ff-9478-5205d4864739 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-57a2fd03-e864-49ee-be7a-154ab16f999e 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:30 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11b8f65-d832-4660-92a5-a01f92850043]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:59:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3c7472bf-6fb2-4b56-959f-4af10d57f6c5 tempest-CreateVolumesFromSnapshotTest-323228305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-db9096a6-e914-4b96-87e3-9271d466c3ad {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:30 devstack sudo[91425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-57a2fd03-e864-49ee-be7a-154ab16f999e 1073741824 Apr 24 13:59:30 devstack sudo[91425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:30 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-9419156e-01e2-4b24-bfd2-96b944bd26e7 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (282f738f-e576-43ac-aa52-7812014e9be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0473307-912b-4b03-9ec8-2b42279c01a9', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:30 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-9419156e-01e2-4b24-bfd2-96b944bd26e7 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b814cfea-755a-4404-8faf-f40ba663ca78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:30 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-9419156e-01e2-4b24-bfd2-96b944bd26e7 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Volume volume-a0473307-912b-4b03-9ec8-2b42279c01a9 (a0473307-912b-4b03-9ec8-2b42279c01a9): created successfully Apr 24 13:59:30 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-9419156e-01e2-4b24-bfd2-96b944bd26e7 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b814cfea-755a-4404-8faf-f40ba663ca78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:30 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-9419156e-01e2-4b24-bfd2-96b944bd26e7 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Flow 'volume_create_manager' (2bc055fa-6cec-4ed5-a3d2-b72df028aa8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:59:30 devstack sudo[91421]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:30 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-9419156e-01e2-4b24-bfd2-96b944bd26e7 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Created volume successfully. Apr 24 13:59:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-94f2c21f-dd34-4e62-bf55-cfe7b353214c tempest-CreateVolumesFromSnapshotTest-323228305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.537s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:30 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-94f2c21f-dd34-4e62-bf55-cfe7b353214c tempest-CreateVolumesFromSnapshotTest-323228305 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:59:30 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-94f2c21f-dd34-4e62-bf55-cfe7b353214c tempest-CreateVolumesFromSnapshotTest-323228305 None] Deleted volume successfully. Apr 24 13:59:30 devstack sudo[91426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-db9096a6-e914-4b96-87e3-9271d466c3ad Apr 24 13:59:30 devstack sudo[91426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:30 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-94f2c21f-dd34-4e62-bf55-cfe7b353214c tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "cinder-a9254918-44ae-4b5a-ab69-0a9ef551f0f0-delete_volume" released by "delete_volume" :: held 2.550s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:59:30 devstack sudo[91426]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3c7472bf-6fb2-4b56-959f-4af10d57f6c5 tempest-CreateVolumesFromSnapshotTest-323228305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-db9096a6-e914-4b96-87e3-9271d466c3ad" returned: 0 in 0.653s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3c7472bf-6fb2-4b56-959f-4af10d57f6c5 tempest-CreateVolumesFromSnapshotTest-323228305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-db9096a6-e914-4b96-87e3-9271d466c3ad {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:30 devstack sudo[91425]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b4753349-3be7-47ff-9478-5205d4864739 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-57a2fd03-e864-49ee-be7a-154ab16f999e 1073741824" returned: 0 in 0.688s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:30 devstack sudo[91435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-db9096a6-e914-4b96-87e3-9271d466c3ad Apr 24 13:59:30 devstack sudo[91435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:30 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b4753349-3be7-47ff-9478-5205d4864739 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-57a2fd03-e864-49ee-be7a-154ab16f999e {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:30 devstack sudo[91437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-57a2fd03-e864-49ee-be7a-154ab16f999e Apr 24 13:59:30 devstack sudo[91437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:31 devstack sudo[91435]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3c7472bf-6fb2-4b56-959f-4af10d57f6c5 tempest-CreateVolumesFromSnapshotTest-323228305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-db9096a6-e914-4b96-87e3-9271d466c3ad" returned: 0 in 0.555s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:31 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-3c7472bf-6fb2-4b56-959f-4af10d57f6c5 tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "cinder-quobyte-db9096a6-e914-4b96-87e3-9271d466c3ad" released by "delete_volume" :: held 1.277s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:59:31 devstack sudo[91437]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b4753349-3be7-47ff-9478-5205d4864739 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-57a2fd03-e864-49ee-be7a-154ab16f999e" returned: 0 in 0.552s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:31 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b4753349-3be7-47ff-9478-5205d4864739 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] <== create_volume: return (1283ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:59:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b4753349-3be7-47ff-9478-5205d4864739 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.287s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:59:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4d036541-07eb-46f7-b752-ab39a841bbc6 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.509s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:59:31 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-4d036541-07eb-46f7-b752-ab39a841bbc6 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-34070757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6977af4-1428-413d-ad20-ebc1e469abe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='615d789bb4dd4a3ca71c1ec449f20ba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:59:22Z,use_quota=True,user_id='542d00693e2741a1bb7698649b0d9b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:59:31 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-4d036541-07eb-46f7-b752-ab39a841bbc6 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Creating volume e6977af4-1428-413d-ad20-ebc1e469abe9 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:59:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4d036541-07eb-46f7-b752-ab39a841bbc6 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:59:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4d036541-07eb-46f7-b752-ab39a841bbc6 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:59:31 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-4d036541-07eb-46f7-b752-ab39a841bbc6 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:59:31 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-4d036541-07eb-46f7-b752-ab39a841bbc6 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:59:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4d036541-07eb-46f7-b752-ab39a841bbc6 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:59:31 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-4d036541-07eb-46f7-b752-ab39a841bbc6 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:59:31 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-4d036541-07eb-46f7-b752-ab39a841bbc6 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:59:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4d036541-07eb-46f7-b752-ab39a841bbc6 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e6977af4-1428-413d-ad20-ebc1e469abe9 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:31 devstack sudo[91441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e6977af4-1428-413d-ad20-ebc1e469abe9 1073741824 Apr 24 13:59:31 devstack sudo[91441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b4753349-3be7-47ff-9478-5205d4864739 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8edae0d7-7eac-487e-8cac-14ae70eedbaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57a2fd03-e864-49ee-be7a-154ab16f999e', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b4753349-3be7-47ff-9478-5205d4864739 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68f280f4-e424-4a90-a695-e8af2fa16f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:31 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-b4753349-3be7-47ff-9478-5205d4864739 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Volume volume-57a2fd03-e864-49ee-be7a-154ab16f999e (57a2fd03-e864-49ee-be7a-154ab16f999e): created successfully Apr 24 13:59:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b4753349-3be7-47ff-9478-5205d4864739 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68f280f4-e424-4a90-a695-e8af2fa16f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:31 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-b4753349-3be7-47ff-9478-5205d4864739 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Flow 'volume_create_manager' (9a928594-34ed-454d-bfe4-33534a4ea8d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:59:31 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-3c7472bf-6fb2-4b56-959f-4af10d57f6c5 tempest-CreateVolumesFromSnapshotTest-323228305 None] Created reservations ['43371bde-082a-4364-a22c-8ce9c1d8a8e3', '6c16a838-79cf-4a4e-a370-5d954621bca1', '196d61df-e2ab-4c59-9c48-cf6370575f5a', '32259905-8d5d-4ebd-8e3c-2b230f041364'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:59:31 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-b4753349-3be7-47ff-9478-5205d4864739 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Created volume successfully. Apr 24 13:59:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-3c7472bf-6fb2-4b56-959f-4af10d57f6c5 tempest-CreateVolumesFromSnapshotTest-323228305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:59:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-3c7472bf-6fb2-4b56-959f-4af10d57f6c5 tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:59:31 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-3c7472bf-6fb2-4b56-959f-4af10d57f6c5 tempest-CreateVolumesFromSnapshotTest-323228305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:59:31 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-3c7472bf-6fb2-4b56-959f-4af10d57f6c5 tempest-CreateVolumesFromSnapshotTest-323228305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:59:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-3c7472bf-6fb2-4b56-959f-4af10d57f6c5 tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:59:31 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3c7472bf-6fb2-4b56-959f-4af10d57f6c5 tempest-CreateVolumesFromSnapshotTest-323228305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:31 devstack sudo[91443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:59:31 devstack sudo[91443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:32 devstack sudo[91441]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4d036541-07eb-46f7-b752-ab39a841bbc6 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e6977af4-1428-413d-ad20-ebc1e469abe9 1073741824" returned: 0 in 0.645s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4d036541-07eb-46f7-b752-ab39a841bbc6 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e6977af4-1428-413d-ad20-ebc1e469abe9 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:32 devstack sudo[91443]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3c7472bf-6fb2-4b56-959f-4af10d57f6c5 tempest-CreateVolumesFromSnapshotTest-323228305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.530s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:32 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-3c7472bf-6fb2-4b56-959f-4af10d57f6c5 tempest-CreateVolumesFromSnapshotTest-323228305 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:59:32 devstack sudo[91449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e6977af4-1428-413d-ad20-ebc1e469abe9 Apr 24 13:59:32 devstack sudo[91449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:32 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-3c7472bf-6fb2-4b56-959f-4af10d57f6c5 tempest-CreateVolumesFromSnapshotTest-323228305 None] Deleted volume successfully. Apr 24 13:59:32 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-3c7472bf-6fb2-4b56-959f-4af10d57f6c5 tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "cinder-db9096a6-e914-4b96-87e3-9271d466c3ad-delete_volume" released by "delete_volume" :: held 2.158s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:59:32 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b0e2b73a-0e4a-4714-83a0-26e1c0b84837 tempest-CreateVolumesFromSnapshotTest-323228305 None] Acquiring lock "cinder-8e6444cb-a300-460e-8cfe-0e1cac3bb5ca-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:59:32 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b0e2b73a-0e4a-4714-83a0-26e1c0b84837 tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "cinder-8e6444cb-a300-460e-8cfe-0e1cac3bb5ca-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:59:32 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b0e2b73a-0e4a-4714-83a0-26e1c0b84837 tempest-CreateVolumesFromSnapshotTest-323228305 None] Acquiring lock "cinder-quobyte-8e6444cb-a300-460e-8cfe-0e1cac3bb5ca" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:59:32 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b0e2b73a-0e4a-4714-83a0-26e1c0b84837 tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "cinder-quobyte-8e6444cb-a300-460e-8cfe-0e1cac3bb5ca" acquired by "delete_volume" :: waited 0.031s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:59:32 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[195fd192-f8f6-4200-aad7-c6b7287bf379]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:59:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b0e2b73a-0e4a-4714-83a0-26e1c0b84837 tempest-CreateVolumesFromSnapshotTest-323228305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-8e6444cb-a300-460e-8cfe-0e1cac3bb5ca {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:32 devstack sudo[91451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-8e6444cb-a300-460e-8cfe-0e1cac3bb5ca Apr 24 13:59:32 devstack sudo[91451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:32 devstack sudo[91449]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-4d036541-07eb-46f7-b752-ab39a841bbc6 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e6977af4-1428-413d-ad20-ebc1e469abe9" returned: 0 in 0.582s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:32 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-4d036541-07eb-46f7-b752-ab39a841bbc6 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] <== create_volume: return (1274ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:59:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-4d036541-07eb-46f7-b752-ab39a841bbc6 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.278s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:59:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-3d1bcefd-b05b-447c-a2ee-b20f19c11009 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.381s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:59:32 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-3d1bcefd-b05b-447c-a2ee-b20f19c11009 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-265060903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=468dce69-0dc2-47b8-9ee2-133bb469e887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='615d789bb4dd4a3ca71c1ec449f20ba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:59:28Z,use_quota=True,user_id='542d00693e2741a1bb7698649b0d9b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:59:32 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-3d1bcefd-b05b-447c-a2ee-b20f19c11009 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Creating volume 468dce69-0dc2-47b8-9ee2-133bb469e887 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:59:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-3d1bcefd-b05b-447c-a2ee-b20f19c11009 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:59:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-3d1bcefd-b05b-447c-a2ee-b20f19c11009 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:59:32 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-3d1bcefd-b05b-447c-a2ee-b20f19c11009 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:59:32 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-3d1bcefd-b05b-447c-a2ee-b20f19c11009 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:59:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-3d1bcefd-b05b-447c-a2ee-b20f19c11009 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:59:32 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-3d1bcefd-b05b-447c-a2ee-b20f19c11009 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:59:32 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-3d1bcefd-b05b-447c-a2ee-b20f19c11009 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:59:32 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3d1bcefd-b05b-447c-a2ee-b20f19c11009 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-468dce69-0dc2-47b8-9ee2-133bb469e887 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:32 devstack sudo[91454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-468dce69-0dc2-47b8-9ee2-133bb469e887 1073741824 Apr 24 13:59:32 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4d036541-07eb-46f7-b752-ab39a841bbc6 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97e73c1a-c42c-498a-aa3d-480f229b35bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6977af4-1428-413d-ad20-ebc1e469abe9', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:32 devstack sudo[91454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:32 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4d036541-07eb-46f7-b752-ab39a841bbc6 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9867c0da-e9c7-4760-848f-953fcf1f25a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:32 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-4d036541-07eb-46f7-b752-ab39a841bbc6 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Volume volume-e6977af4-1428-413d-ad20-ebc1e469abe9 (e6977af4-1428-413d-ad20-ebc1e469abe9): created successfully Apr 24 13:59:32 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4d036541-07eb-46f7-b752-ab39a841bbc6 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9867c0da-e9c7-4760-848f-953fcf1f25a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:32 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-4d036541-07eb-46f7-b752-ab39a841bbc6 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Flow 'volume_create_manager' (4f8cbbe6-c072-4650-a53e-cf5d103e543e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:59:32 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-4d036541-07eb-46f7-b752-ab39a841bbc6 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Created volume successfully. Apr 24 13:59:33 devstack sudo[91451]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b0e2b73a-0e4a-4714-83a0-26e1c0b84837 tempest-CreateVolumesFromSnapshotTest-323228305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-8e6444cb-a300-460e-8cfe-0e1cac3bb5ca" returned: 0 in 0.607s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b0e2b73a-0e4a-4714-83a0-26e1c0b84837 tempest-CreateVolumesFromSnapshotTest-323228305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-8e6444cb-a300-460e-8cfe-0e1cac3bb5ca {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:33 devstack sudo[91459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-8e6444cb-a300-460e-8cfe-0e1cac3bb5ca Apr 24 13:59:33 devstack sudo[91459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:33 devstack sudo[91454]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3d1bcefd-b05b-447c-a2ee-b20f19c11009 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-468dce69-0dc2-47b8-9ee2-133bb469e887 1073741824" returned: 0 in 0.823s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3d1bcefd-b05b-447c-a2ee-b20f19c11009 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-468dce69-0dc2-47b8-9ee2-133bb469e887 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:33 devstack sudo[91459]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b0e2b73a-0e4a-4714-83a0-26e1c0b84837 tempest-CreateVolumesFromSnapshotTest-323228305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-8e6444cb-a300-460e-8cfe-0e1cac3bb5ca" returned: 0 in 0.561s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:33 devstack sudo[91467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-468dce69-0dc2-47b8-9ee2-133bb469e887 Apr 24 13:59:33 devstack sudo[91467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:33 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b0e2b73a-0e4a-4714-83a0-26e1c0b84837 tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "cinder-quobyte-8e6444cb-a300-460e-8cfe-0e1cac3bb5ca" released by "delete_volume" :: held 1.220s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:59:33 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-b0e2b73a-0e4a-4714-83a0-26e1c0b84837 tempest-CreateVolumesFromSnapshotTest-323228305 None] Created reservations ['814b83fc-ef5b-4e95-aa16-6c7a4f290e28', '5817057e-7cf6-4545-92b1-78b700f6fdaf', 'fa219232-0aee-42f1-bd00-4900dfdc541d', 'd25ad483-0bf5-490b-8a20-6ba771978423'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:59:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b0e2b73a-0e4a-4714-83a0-26e1c0b84837 tempest-CreateVolumesFromSnapshotTest-323228305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:59:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b0e2b73a-0e4a-4714-83a0-26e1c0b84837 tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:59:33 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b0e2b73a-0e4a-4714-83a0-26e1c0b84837 tempest-CreateVolumesFromSnapshotTest-323228305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:59:33 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b0e2b73a-0e4a-4714-83a0-26e1c0b84837 tempest-CreateVolumesFromSnapshotTest-323228305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:59:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b0e2b73a-0e4a-4714-83a0-26e1c0b84837 tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:59:33 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b0e2b73a-0e4a-4714-83a0-26e1c0b84837 tempest-CreateVolumesFromSnapshotTest-323228305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:33 devstack sudo[91469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:59:33 devstack sudo[91469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:34 devstack sudo[91467]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3d1bcefd-b05b-447c-a2ee-b20f19c11009 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-468dce69-0dc2-47b8-9ee2-133bb469e887" returned: 0 in 0.476s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:34 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-3d1bcefd-b05b-447c-a2ee-b20f19c11009 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] <== create_volume: return (1339ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 13:59:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-3d1bcefd-b05b-447c-a2ee-b20f19c11009 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.342s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:59:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 5.428s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:59:34 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Cloning volume f4e024a8-e590-4058-8266-9f96b0d66f4e to volume f106ad93-380f-412d-9bc1-0f26cd5d6369 Apr 24 13:59:34 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-3d1bcefd-b05b-447c-a2ee-b20f19c11009 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73a300b3-17e6-4f9d-a335-3473600234f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-468dce69-0dc2-47b8-9ee2-133bb469e887', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:34 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-3d1bcefd-b05b-447c-a2ee-b20f19c11009 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb136196-b802-4d08-ac10-fa04aa723c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:34 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-3d1bcefd-b05b-447c-a2ee-b20f19c11009 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Volume volume-468dce69-0dc2-47b8-9ee2-133bb469e887 (468dce69-0dc2-47b8-9ee2-133bb469e887): created successfully Apr 24 13:59:34 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-3d1bcefd-b05b-447c-a2ee-b20f19c11009 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb136196-b802-4d08-ac10-fa04aa723c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:34 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-3d1bcefd-b05b-447c-a2ee-b20f19c11009 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Flow 'volume_create_manager' (f1ca348e-5428-4819-baf6-0799b8385efb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:59:34 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Creating offline snapshot caa81c2b-26c7-4867-9561-c887fc798388 of volume f4e024a8-e590-4058-8266-9f96b0d66f4e {{(pid=82046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 13:59:34 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-3d1bcefd-b05b-447c-a2ee-b20f19c11009 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Created volume successfully. Apr 24 13:59:34 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[66335557-2153-4f15-9adf-c1567b850f11]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:59:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:34 devstack sudo[91469]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b0e2b73a-0e4a-4714-83a0-26e1c0b84837 tempest-CreateVolumesFromSnapshotTest-323228305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.514s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:34 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-b0e2b73a-0e4a-4714-83a0-26e1c0b84837 tempest-CreateVolumesFromSnapshotTest-323228305 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:59:34 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-b0e2b73a-0e4a-4714-83a0-26e1c0b84837 tempest-CreateVolumesFromSnapshotTest-323228305 None] Deleted volume successfully. Apr 24 13:59:34 devstack sudo[91473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e Apr 24 13:59:34 devstack sudo[91473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:34 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b0e2b73a-0e4a-4714-83a0-26e1c0b84837 tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "cinder-8e6444cb-a300-460e-8cfe-0e1cac3bb5ca-delete_volume" released by "delete_volume" :: held 1.972s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:59:34 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ce9f99bf-8738-4181-aa41-6597e8783501 tempest-CreateVolumesFromSnapshotTest-323228305 None] Acquiring lock "cinder-45960c6c-f299-4951-aeab-2d24fb7ff575-delete_snapshot" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:59:34 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ce9f99bf-8738-4181-aa41-6597e8783501 tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "cinder-45960c6c-f299-4951-aeab-2d24fb7ff575-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:59:34 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ce9f99bf-8738-4181-aa41-6597e8783501 tempest-CreateVolumesFromSnapshotTest-323228305 None] Acquiring lock "cinder-quobyte-9c080eba-eeeb-4d7a-a592-a419809b3b8c" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:59:34 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ce9f99bf-8738-4181-aa41-6597e8783501 tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "cinder-quobyte-9c080eba-eeeb-4d7a-a592-a419809b3b8c" acquired by "delete_snapshot" :: waited 0.053s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:59:34 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ce9f99bf-8738-4181-aa41-6597e8783501 tempest-CreateVolumesFromSnapshotTest-323228305 None] Acquiring lock "cinder-quobyte-45960c6c-f299-4951-aeab-2d24fb7ff575" by "_delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:59:34 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ce9f99bf-8738-4181-aa41-6597e8783501 tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "cinder-quobyte-45960c6c-f299-4951-aeab-2d24fb7ff575" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:59:34 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-ce9f99bf-8738-4181-aa41-6597e8783501 tempest-CreateVolumesFromSnapshotTest-323228305 None] Deleting offline snapshot 45960c6c-f299-4951-aeab-2d24fb7ff575 of volume 9c080eba-eeeb-4d7a-a592-a419809b3b8c {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 13:59:34 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-ce9f99bf-8738-4181-aa41-6597e8783501 tempest-CreateVolumesFromSnapshotTest-323228305 None] snapshot_file for this snap is: volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c.45960c6c-f299-4951-aeab-2d24fb7ff575 {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 13:59:34 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-6a755d74-6445-46d4-a9d5-7a490bae54df tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Acquiring lock "cinder-468dce69-0dc2-47b8-9ee2-133bb469e887-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:59:34 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ff55f7-8047-4c68-a8b8-020591113854]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:59:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ce9f99bf-8738-4181-aa41-6597e8783501 tempest-CreateVolumesFromSnapshotTest-323228305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c.45960c6c-f299-4951-aeab-2d24fb7ff575 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:34 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-6a755d74-6445-46d4-a9d5-7a490bae54df tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "cinder-468dce69-0dc2-47b8-9ee2-133bb469e887-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:59:34 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-6a755d74-6445-46d4-a9d5-7a490bae54df tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Acquiring lock "cinder-quobyte-468dce69-0dc2-47b8-9ee2-133bb469e887" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:59:34 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-6a755d74-6445-46d4-a9d5-7a490bae54df tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "cinder-quobyte-468dce69-0dc2-47b8-9ee2-133bb469e887" acquired by "delete_volume" :: waited 0.021s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:59:34 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[0009f450-3202-4453-be8b-8a7de94c6bfa]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:59:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6a755d74-6445-46d4-a9d5-7a490bae54df tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-468dce69-0dc2-47b8-9ee2-133bb469e887 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:34 devstack sudo[91473]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:34 devstack sudo[91478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c.45960c6c-f299-4951-aeab-2d24fb7ff575 Apr 24 13:59:34 devstack sudo[91478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e" returned: 0 in 0.690s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:34 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e.caa81c2b-26c7-4867-9561-c887fc798388 1G {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:34 devstack sudo[91481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e.caa81c2b-26c7-4867-9561-c887fc798388 1G Apr 24 13:59:34 devstack sudo[91481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:34 devstack sudo[91479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-468dce69-0dc2-47b8-9ee2-133bb469e887 Apr 24 13:59:34 devstack sudo[91479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:35 devstack sudo[91478]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ce9f99bf-8738-4181-aa41-6597e8783501 tempest-CreateVolumesFromSnapshotTest-323228305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c.45960c6c-f299-4951-aeab-2d24fb7ff575" returned: 0 in 0.697s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:35 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-ce9f99bf-8738-4181-aa41-6597e8783501 tempest-CreateVolumesFromSnapshotTest-323228305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:59:35 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbd702d-7246-44ec-8431-5e0ea1fedf40]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:59:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ce9f99bf-8738-4181-aa41-6597e8783501 tempest-CreateVolumesFromSnapshotTest-323228305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:35 devstack sudo[91479]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6a755d74-6445-46d4-a9d5-7a490bae54df tempest-CreateVolumesFromSourceVolumeTest-103316046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-468dce69-0dc2-47b8-9ee2-133bb469e887" returned: 0 in 0.653s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6a755d74-6445-46d4-a9d5-7a490bae54df tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-468dce69-0dc2-47b8-9ee2-133bb469e887 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:35 devstack sudo[91494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-468dce69-0dc2-47b8-9ee2-133bb469e887 Apr 24 13:59:35 devstack sudo[91494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:35 devstack sudo[91493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c Apr 24 13:59:35 devstack sudo[91493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:35 devstack sudo[91481]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e.caa81c2b-26c7-4867-9561-c887fc798388 1G" returned: 0 in 0.763s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:35 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4e024a8-e590-4058-8266-9f96b0d66f4e -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e.caa81c2b-26c7-4867-9561-c887fc798388 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:35 devstack sudo[91497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4e024a8-e590-4058-8266-9f96b0d66f4e -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e.caa81c2b-26c7-4867-9561-c887fc798388 Apr 24 13:59:35 devstack sudo[91497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:36 devstack sudo[91494]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6a755d74-6445-46d4-a9d5-7a490bae54df tempest-CreateVolumesFromSourceVolumeTest-103316046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-468dce69-0dc2-47b8-9ee2-133bb469e887" returned: 0 in 0.513s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:36 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-6a755d74-6445-46d4-a9d5-7a490bae54df tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "cinder-quobyte-468dce69-0dc2-47b8-9ee2-133bb469e887" released by "delete_volume" :: held 1.212s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:59:36 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-6a755d74-6445-46d4-a9d5-7a490bae54df tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Created reservations ['ca6996ae-3a42-4fbd-b82e-7eef893acd23', '8ac1125c-7ea7-42ef-bec8-e4a4c55fa565', 'de4ffa22-c5c6-4141-99f1-6f99921e788b', '384abada-4730-478f-a981-8de9bef88ccb'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:59:36 devstack sudo[91493]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ce9f99bf-8738-4181-aa41-6597e8783501 tempest-CreateVolumesFromSnapshotTest-323228305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c" returned: 0 in 0.698s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ce9f99bf-8738-4181-aa41-6597e8783501 tempest-CreateVolumesFromSnapshotTest-323228305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c.45960c6c-f299-4951-aeab-2d24fb7ff575 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-6a755d74-6445-46d4-a9d5-7a490bae54df tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:59:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-6a755d74-6445-46d4-a9d5-7a490bae54df tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:59:36 devstack sudo[91507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c.45960c6c-f299-4951-aeab-2d24fb7ff575 Apr 24 13:59:36 devstack sudo[91507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:36 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-6a755d74-6445-46d4-a9d5-7a490bae54df tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:59:36 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-6a755d74-6445-46d4-a9d5-7a490bae54df tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:59:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-6a755d74-6445-46d4-a9d5-7a490bae54df tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:59:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6a755d74-6445-46d4-a9d5-7a490bae54df tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:36 devstack sudo[91509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:59:36 devstack sudo[91509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:36 devstack sudo[91497]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4e024a8-e590-4058-8266-9f96b0d66f4e -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e.caa81c2b-26c7-4867-9561-c887fc798388" returned: 0 in 0.629s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:36 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e.caa81c2b-26c7-4867-9561-c887fc798388 is being set with open permissions: ugo+rw Apr 24 13:59:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e.caa81c2b-26c7-4867-9561-c887fc798388 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:36 devstack sudo[91511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e.caa81c2b-26c7-4867-9561-c887fc798388 Apr 24 13:59:36 devstack sudo[91511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:36 devstack sudo[91509]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-6a755d74-6445-46d4-a9d5-7a490bae54df tempest-CreateVolumesFromSourceVolumeTest-103316046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.518s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:36 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-6a755d74-6445-46d4-a9d5-7a490bae54df tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:59:36 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-6a755d74-6445-46d4-a9d5-7a490bae54df tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Deleted volume successfully. Apr 24 13:59:36 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-6a755d74-6445-46d4-a9d5-7a490bae54df tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "cinder-468dce69-0dc2-47b8-9ee2-133bb469e887-delete_volume" released by "delete_volume" :: held 2.001s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:59:36 devstack sudo[91511]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e.caa81c2b-26c7-4867-9561-c887fc798388" returned: 0 in 0.529s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:36 devstack sudo[91507]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ce9f99bf-8738-4181-aa41-6597e8783501 tempest-CreateVolumesFromSnapshotTest-323228305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c.45960c6c-f299-4951-aeab-2d24fb7ff575" returned: 0 in 0.649s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:36 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ce9f99bf-8738-4181-aa41-6597e8783501 tempest-CreateVolumesFromSnapshotTest-323228305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c.45960c6c-f299-4951-aeab-2d24fb7ff575 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:36 devstack sudo[91518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e.info Apr 24 13:59:36 devstack sudo[91518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:36 devstack sudo[91519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c.45960c6c-f299-4951-aeab-2d24fb7ff575 Apr 24 13:59:36 devstack sudo[91519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:36 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-c892412f-b500-4a57-af5e-f40f4cb83029 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Acquiring lock "cinder-e6977af4-1428-413d-ad20-ebc1e469abe9-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:59:37 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-c892412f-b500-4a57-af5e-f40f4cb83029 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "cinder-e6977af4-1428-413d-ad20-ebc1e469abe9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:59:37 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-c892412f-b500-4a57-af5e-f40f4cb83029 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Acquiring lock "cinder-quobyte-e6977af4-1428-413d-ad20-ebc1e469abe9" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:59:37 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-c892412f-b500-4a57-af5e-f40f4cb83029 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "cinder-quobyte-e6977af4-1428-413d-ad20-ebc1e469abe9" acquired by "delete_volume" :: waited 0.024s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:59:37 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c3bbcc-5efe-42eb-97b7-e31fd1c3d3f2]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:59:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-c892412f-b500-4a57-af5e-f40f4cb83029 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e6977af4-1428-413d-ad20-ebc1e469abe9 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:37 devstack sudo[91522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e6977af4-1428-413d-ad20-ebc1e469abe9 Apr 24 13:59:37 devstack sudo[91522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:37 devstack sudo[91518]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e.info" returned: 0 in 0.544s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:37 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e.info is being set with open permissions: ugo+rw Apr 24 13:59:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:37 devstack sudo[91526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e.info Apr 24 13:59:37 devstack sudo[91526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:37 devstack sudo[91519]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ce9f99bf-8738-4181-aa41-6597e8783501 tempest-CreateVolumesFromSnapshotTest-323228305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c.45960c6c-f299-4951-aeab-2d24fb7ff575" returned: 0 in 0.561s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:37 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ce9f99bf-8738-4181-aa41-6597e8783501 tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "cinder-quobyte-45960c6c-f299-4951-aeab-2d24fb7ff575" released by "_delete_snapshot" :: held 2.761s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:59:37 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ce9f99bf-8738-4181-aa41-6597e8783501 tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "cinder-quobyte-9c080eba-eeeb-4d7a-a592-a419809b3b8c" released by "delete_snapshot" :: held 2.789s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:59:37 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-ce9f99bf-8738-4181-aa41-6597e8783501 tempest-CreateVolumesFromSnapshotTest-323228305 None] Created reservations ['da297fe8-93d9-495a-953e-9c22218b63a3', '1f17edc9-a2af-4c27-b463-36863102e434', '43d2b365-e061-4402-a283-f77aefc47191', '02184dc6-daa7-4d1d-8300-d058c7a25e62'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:59:37 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-ce9f99bf-8738-4181-aa41-6597e8783501 tempest-CreateVolumesFromSnapshotTest-323228305 None] Delete snapshot completed successfully. Apr 24 13:59:37 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ce9f99bf-8738-4181-aa41-6597e8783501 tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "cinder-45960c6c-f299-4951-aeab-2d24fb7ff575-delete_snapshot" released by "delete_snapshot" :: held 3.022s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:59:37 devstack sudo[91522]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-c892412f-b500-4a57-af5e-f40f4cb83029 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e6977af4-1428-413d-ad20-ebc1e469abe9" returned: 0 in 0.645s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-c892412f-b500-4a57-af5e-f40f4cb83029 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e6977af4-1428-413d-ad20-ebc1e469abe9 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:37 devstack sudo[91531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e6977af4-1428-413d-ad20-ebc1e469abe9 Apr 24 13:59:37 devstack sudo[91531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:37 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-45ae5021-5e0e-45d5-ac94-6c2260116da6 tempest-CreateVolumesFromSnapshotTest-323228305 None] Acquiring lock "cinder-9c080eba-eeeb-4d7a-a592-a419809b3b8c-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:59:37 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-45ae5021-5e0e-45d5-ac94-6c2260116da6 tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "cinder-9c080eba-eeeb-4d7a-a592-a419809b3b8c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:59:37 devstack cinder-volume[82046]: DEBUG dbcounter [-] [82046] Writing DB stats cinder:UPDATE=185,cinder:SELECT=126,cinder:DELETE=18,cinder:INSERT=40 {{(pid=82046) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 13:59:37 devstack cinder-volume[82046]: DEBUG oslo_service.periodic_task [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82046) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 13:59:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:59:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:59:37 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:59:37 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:59:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:59:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:37 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-45ae5021-5e0e-45d5-ac94-6c2260116da6 tempest-CreateVolumesFromSnapshotTest-323228305 None] Acquiring lock "cinder-quobyte-9c080eba-eeeb-4d7a-a592-a419809b3b8c" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:59:37 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-45ae5021-5e0e-45d5-ac94-6c2260116da6 tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "cinder-quobyte-9c080eba-eeeb-4d7a-a592-a419809b3b8c" acquired by "delete_volume" :: waited 0.021s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:59:37 devstack sudo[91534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:59:37 devstack sudo[91534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:38 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41580bd-1aff-417b-981e-eee8cc85ec44]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:59:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-45ae5021-5e0e-45d5-ac94-6c2260116da6 tempest-CreateVolumesFromSnapshotTest-323228305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:38 devstack sudo[91526]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e.info" returned: 0 in 0.698s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:38 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Acquiring lock "cinder-quobyte-f106ad93-380f-412d-9bc1-0f26cd5d6369" by "_copy_volume_from_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:59:38 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Lock "cinder-quobyte-f106ad93-380f-412d-9bc1-0f26cd5d6369" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:59:38 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] snapshot: caa81c2b-26c7-4867-9561-c887fc798388, volume: f106ad93-380f-412d-9bc1-0f26cd5d6369, {{(pid=82046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 13:59:38 devstack sudo[91536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c Apr 24 13:59:38 devstack sudo[91536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:59:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:59:38 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:59:38 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:59:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:59:38 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63b3631-f680-4f81-9c7e-b1948e711d10]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:59:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e.caa81c2b-26c7-4867-9561-c887fc798388 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:38 devstack sudo[91538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e.caa81c2b-26c7-4867-9561-c887fc798388 Apr 24 13:59:38 devstack sudo[91538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:38 devstack sudo[91531]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-c892412f-b500-4a57-af5e-f40f4cb83029 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e6977af4-1428-413d-ad20-ebc1e469abe9" returned: 0 in 0.606s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:38 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-c892412f-b500-4a57-af5e-f40f4cb83029 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "cinder-quobyte-e6977af4-1428-413d-ad20-ebc1e469abe9" released by "delete_volume" :: held 1.299s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:59:38 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-c892412f-b500-4a57-af5e-f40f4cb83029 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Created reservations ['e744ccd2-c784-4407-81e9-10eae9dabcb9', '1c02ca11-e94d-4496-8b34-13802cdb474a', 'cc2a3d5e-4b89-45db-be7a-baab9be56439', '7957a164-a73b-465c-b2e8-02c5e71aeaa4'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:59:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-c892412f-b500-4a57-af5e-f40f4cb83029 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:59:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-c892412f-b500-4a57-af5e-f40f4cb83029 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:59:38 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-c892412f-b500-4a57-af5e-f40f4cb83029 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:59:38 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-c892412f-b500-4a57-af5e-f40f4cb83029 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:59:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-c892412f-b500-4a57-af5e-f40f4cb83029 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:59:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-c892412f-b500-4a57-af5e-f40f4cb83029 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:38 devstack sudo[91534]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.642s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:38 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:59:38 devstack sudo[91542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:59:38 devstack sudo[91542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:38 devstack sudo[91536]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-45ae5021-5e0e-45d5-ac94-6c2260116da6 tempest-CreateVolumesFromSnapshotTest-323228305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c" returned: 0 in 0.727s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-45ae5021-5e0e-45d5-ac94-6c2260116da6 tempest-CreateVolumesFromSnapshotTest-323228305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:38 devstack sudo[91550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c Apr 24 13:59:38 devstack sudo[91550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:38 devstack sudo[91538]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e.caa81c2b-26c7-4867-9561-c887fc798388" returned: 0 in 0.586s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:38 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4e024a8-e590-4058-8266-9f96b0d66f4e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:59:38 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e {{(pid=82046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 13:59:38 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Creating direct copy from snapshot {{(pid=82046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 13:59:38 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8ef7c3-7b17-497c-8820-742647e0bfcc]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:59:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:38 devstack sudo[91552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e Apr 24 13:59:38 devstack sudo[91552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:39 devstack sudo[91542]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-c892412f-b500-4a57-af5e-f40f4cb83029 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.571s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:39 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-c892412f-b500-4a57-af5e-f40f4cb83029 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:59:39 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-c892412f-b500-4a57-af5e-f40f4cb83029 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Deleted volume successfully. Apr 24 13:59:39 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-c892412f-b500-4a57-af5e-f40f4cb83029 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "cinder-e6977af4-1428-413d-ad20-ebc1e469abe9-delete_volume" released by "delete_volume" :: held 2.164s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:59:39 devstack sudo[91550]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:39 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b19c0b45-c1e5-496d-8e3a-4c00c034c079 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Acquiring lock "cinder-57a2fd03-e864-49ee-be7a-154ab16f999e-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:59:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-45ae5021-5e0e-45d5-ac94-6c2260116da6 tempest-CreateVolumesFromSnapshotTest-323228305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-9c080eba-eeeb-4d7a-a592-a419809b3b8c" returned: 0 in 0.564s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:39 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-45ae5021-5e0e-45d5-ac94-6c2260116da6 tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "cinder-quobyte-9c080eba-eeeb-4d7a-a592-a419809b3b8c" released by "delete_volume" :: held 1.365s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:59:39 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b19c0b45-c1e5-496d-8e3a-4c00c034c079 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "cinder-57a2fd03-e864-49ee-be7a-154ab16f999e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:59:39 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b19c0b45-c1e5-496d-8e3a-4c00c034c079 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Acquiring lock "cinder-quobyte-57a2fd03-e864-49ee-be7a-154ab16f999e" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:59:39 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-45ae5021-5e0e-45d5-ac94-6c2260116da6 tempest-CreateVolumesFromSnapshotTest-323228305 None] Created reservations ['14519d8c-d8da-4e95-9bc7-6ddf0b5376c3', 'db49b1a5-2683-4ac3-a6a9-d8c362aaf4a8', 'bf41a532-092b-4077-8e38-72931492baf2', '31e8306b-7fe9-4ceb-be1d-188f80439bfc'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:59:39 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b19c0b45-c1e5-496d-8e3a-4c00c034c079 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "cinder-quobyte-57a2fd03-e864-49ee-be7a-154ab16f999e" acquired by "delete_volume" :: waited 0.030s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:59:39 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1165e2f-6894-4b65-a76b-74fae13c0bb0]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:59:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b19c0b45-c1e5-496d-8e3a-4c00c034c079 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-57a2fd03-e864-49ee-be7a-154ab16f999e {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-45ae5021-5e0e-45d5-ac94-6c2260116da6 tempest-CreateVolumesFromSnapshotTest-323228305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:59:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-45ae5021-5e0e-45d5-ac94-6c2260116da6 tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:59:39 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-45ae5021-5e0e-45d5-ac94-6c2260116da6 tempest-CreateVolumesFromSnapshotTest-323228305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:59:39 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-45ae5021-5e0e-45d5-ac94-6c2260116da6 tempest-CreateVolumesFromSnapshotTest-323228305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:59:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-45ae5021-5e0e-45d5-ac94-6c2260116da6 tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:59:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-45ae5021-5e0e-45d5-ac94-6c2260116da6 tempest-CreateVolumesFromSnapshotTest-323228305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:39 devstack sudo[91552]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e" returned: 0 in 0.757s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:39 devstack cinder-volume[82046]: DEBUG cinder.utils [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Path /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f106ad93-380f-412d-9bc1-0f26cd5d6369 not found in is_blk_device check {{(pid=82046) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 13:59:39 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f106ad93-380f-412d-9bc1-0f26cd5d6369 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:39 devstack sudo[91559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-57a2fd03-e864-49ee-be7a-154ab16f999e Apr 24 13:59:39 devstack sudo[91559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:39 devstack sudo[91560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:59:39 devstack sudo[91560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:39 devstack sudo[91562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f106ad93-380f-412d-9bc1-0f26cd5d6369 Apr 24 13:59:39 devstack sudo[91562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:40 devstack sudo[91559]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:40 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b19c0b45-c1e5-496d-8e3a-4c00c034c079 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-57a2fd03-e864-49ee-be7a-154ab16f999e" returned: 0 in 0.548s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:40 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b19c0b45-c1e5-496d-8e3a-4c00c034c079 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-57a2fd03-e864-49ee-be7a-154ab16f999e {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:40 devstack sudo[91572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-57a2fd03-e864-49ee-be7a-154ab16f999e Apr 24 13:59:40 devstack sudo[91572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:40 devstack sudo[91560]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:40 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-45ae5021-5e0e-45d5-ac94-6c2260116da6 tempest-CreateVolumesFromSnapshotTest-323228305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.536s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:40 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-45ae5021-5e0e-45d5-ac94-6c2260116da6 tempest-CreateVolumesFromSnapshotTest-323228305 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:59:40 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-45ae5021-5e0e-45d5-ac94-6c2260116da6 tempest-CreateVolumesFromSnapshotTest-323228305 None] Deleted volume successfully. Apr 24 13:59:40 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-45ae5021-5e0e-45d5-ac94-6c2260116da6 tempest-CreateVolumesFromSnapshotTest-323228305 None] Lock "cinder-9c080eba-eeeb-4d7a-a592-a419809b3b8c-delete_volume" released by "delete_volume" :: held 2.284s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:59:41 devstack sudo[91572]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b19c0b45-c1e5-496d-8e3a-4c00c034c079 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-57a2fd03-e864-49ee-be7a-154ab16f999e" returned: 0 in 1.246s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:41 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b19c0b45-c1e5-496d-8e3a-4c00c034c079 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "cinder-quobyte-57a2fd03-e864-49ee-be7a-154ab16f999e" released by "delete_volume" :: held 1.871s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:59:41 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-b19c0b45-c1e5-496d-8e3a-4c00c034c079 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Created reservations ['be96c88d-278c-4fb2-aaf6-59005922f621', '2832c715-24ee-4905-a1a8-9ea8a9b591c9', 'bedb4635-bfcc-418d-9a5e-06c80f4d0825', '74d1f5cc-98a7-439e-893e-3467d7fd901e'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:59:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b19c0b45-c1e5-496d-8e3a-4c00c034c079 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:59:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b19c0b45-c1e5-496d-8e3a-4c00c034c079 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:59:41 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b19c0b45-c1e5-496d-8e3a-4c00c034c079 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:59:41 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-b19c0b45-c1e5-496d-8e3a-4c00c034c079 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:59:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-b19c0b45-c1e5-496d-8e3a-4c00c034c079 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:59:41 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b19c0b45-c1e5-496d-8e3a-4c00c034c079 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:41 devstack sudo[91585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:59:41 devstack sudo[91585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:42 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-2a9f983b-215f-49c2-825d-f711b6049598 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Acquiring lock "cinder-a0473307-912b-4b03-9ec8-2b42279c01a9-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:59:42 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-2a9f983b-215f-49c2-825d-f711b6049598 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "cinder-a0473307-912b-4b03-9ec8-2b42279c01a9-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:59:42 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-2a9f983b-215f-49c2-825d-f711b6049598 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Acquiring lock "cinder-quobyte-a0473307-912b-4b03-9ec8-2b42279c01a9" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:59:42 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-2a9f983b-215f-49c2-825d-f711b6049598 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "cinder-quobyte-a0473307-912b-4b03-9ec8-2b42279c01a9" acquired by "delete_volume" :: waited 0.033s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:59:42 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c5ec0a-cf14-45e9-96f4-70972cde5324]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:59:42 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2a9f983b-215f-49c2-825d-f711b6049598 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a0473307-912b-4b03-9ec8-2b42279c01a9 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:42 devstack sudo[91587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a0473307-912b-4b03-9ec8-2b42279c01a9 Apr 24 13:59:42 devstack sudo[91587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:43 devstack sudo[91587]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2a9f983b-215f-49c2-825d-f711b6049598 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a0473307-912b-4b03-9ec8-2b42279c01a9" returned: 0 in 1.374s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2a9f983b-215f-49c2-825d-f711b6049598 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a0473307-912b-4b03-9ec8-2b42279c01a9 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:43 devstack sudo[91595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a0473307-912b-4b03-9ec8-2b42279c01a9 Apr 24 13:59:43 devstack sudo[91595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:43 devstack sudo[91585]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:43 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b19c0b45-c1e5-496d-8e3a-4c00c034c079 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 2.097s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:43 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-b19c0b45-c1e5-496d-8e3a-4c00c034c079 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:59:43 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-b19c0b45-c1e5-496d-8e3a-4c00c034c079 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Deleted volume successfully. Apr 24 13:59:43 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b19c0b45-c1e5-496d-8e3a-4c00c034c079 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "cinder-57a2fd03-e864-49ee-be7a-154ab16f999e-delete_volume" released by "delete_volume" :: held 4.517s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:59:44 devstack sudo[91595]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:44 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2a9f983b-215f-49c2-825d-f711b6049598 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-a0473307-912b-4b03-9ec8-2b42279c01a9" returned: 0 in 1.225s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:44 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-2a9f983b-215f-49c2-825d-f711b6049598 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "cinder-quobyte-a0473307-912b-4b03-9ec8-2b42279c01a9" released by "delete_volume" :: held 2.738s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:59:45 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-2a9f983b-215f-49c2-825d-f711b6049598 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Created reservations ['08d76216-b968-4915-bc57-6fe86d617db4', '77c0e22a-e1d6-48d3-b32a-dc3fb99b1b35', '81811101-5bb7-4134-95a0-6a3fecd7e6a9', 'fa9e2b11-7c18-438f-a811-a69b7e357e6e'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:59:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-2a9f983b-215f-49c2-825d-f711b6049598 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:59:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-2a9f983b-215f-49c2-825d-f711b6049598 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:59:45 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-2a9f983b-215f-49c2-825d-f711b6049598 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:59:45 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-2a9f983b-215f-49c2-825d-f711b6049598 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:59:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-2a9f983b-215f-49c2-825d-f711b6049598 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:59:45 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2a9f983b-215f-49c2-825d-f711b6049598 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:45 devstack sudo[91598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:59:45 devstack sudo[91598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:45 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-3556bfaf-a611-4400-ab62-28e396d44590 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Acquiring lock "cinder-45dd4b7b-670d-40b0-9c60-34fbc34a408f-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:59:45 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-3556bfaf-a611-4400-ab62-28e396d44590 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "cinder-45dd4b7b-670d-40b0-9c60-34fbc34a408f-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:59:46 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-3556bfaf-a611-4400-ab62-28e396d44590 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Acquiring lock "cinder-quobyte-45dd4b7b-670d-40b0-9c60-34fbc34a408f" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:59:46 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-3556bfaf-a611-4400-ab62-28e396d44590 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "cinder-quobyte-45dd4b7b-670d-40b0-9c60-34fbc34a408f" acquired by "delete_volume" :: waited 0.026s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:59:46 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5447d6-5e8b-4979-8405-0cef64976416]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:59:46 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3556bfaf-a611-4400-ab62-28e396d44590 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-45dd4b7b-670d-40b0-9c60-34fbc34a408f {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:46 devstack sudo[91601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-45dd4b7b-670d-40b0-9c60-34fbc34a408f Apr 24 13:59:46 devstack sudo[91601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:46 devstack sudo[91598]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:46 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2a9f983b-215f-49c2-825d-f711b6049598 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 1.278s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:46 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-2a9f983b-215f-49c2-825d-f711b6049598 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:59:46 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-2a9f983b-215f-49c2-825d-f711b6049598 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Deleted volume successfully. Apr 24 13:59:46 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-2a9f983b-215f-49c2-825d-f711b6049598 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "cinder-a0473307-912b-4b03-9ec8-2b42279c01a9-delete_volume" released by "delete_volume" :: held 4.575s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:59:46 devstack sudo[91562]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:46 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f106ad93-380f-412d-9bc1-0f26cd5d6369" returned: 0 in 7.184s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:46 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-a59125aa-d465-4994-9e49-4fd30eaf3cf2 tempest-CinderUnicodeTest-1014839738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 13:59:46 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a59125aa-d465-4994-9e49-4fd30eaf3cf2 tempest-CinderUnicodeTest-1014839738 None] Flow 'volume_create_manager' (319ca6b1-31a0-43d3-a776-a11fb6fc6a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:59:46 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a59125aa-d465-4994-9e49-4fd30eaf3cf2 tempest-CinderUnicodeTest-1014839738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad19b56-4ac8-4491-8ba4-9240a0e55ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:46 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea56fd8-d1f5-4072-bb52-4cf636e4fcbe]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:59:46 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:46 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a59125aa-d465-4994-9e49-4fd30eaf3cf2 tempest-CinderUnicodeTest-1014839738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad19b56-4ac8-4491-8ba4-9240a0e55ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:59:46Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7586a088-1753-45cd-9054-1d21a930678f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e7aa19cdff642f6b69f5f081c85459a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:59:47Z,use_quota=True,user_id='0d62c69f78c24b669a79ae2486ea9757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:46 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a59125aa-d465-4994-9e49-4fd30eaf3cf2 tempest-CinderUnicodeTest-1014839738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e437dd20-9a50-4af9-9444-e897fdcd90cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:46 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a59125aa-d465-4994-9e49-4fd30eaf3cf2 tempest-CinderUnicodeTest-1014839738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e437dd20-9a50-4af9-9444-e897fdcd90cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:46 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a59125aa-d465-4994-9e49-4fd30eaf3cf2 tempest-CinderUnicodeTest-1014839738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4e29cc5-474a-453b-937f-05a6d0ab089d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:46 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a59125aa-d465-4994-9e49-4fd30eaf3cf2 tempest-CinderUnicodeTest-1014839738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4e29cc5-474a-453b-937f-05a6d0ab089d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7586a088-1753-45cd-9054-1d21a930678f', 'volume_name': 'volume-7586a088-1753-45cd-9054-1d21a930678f', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:46 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a59125aa-d465-4994-9e49-4fd30eaf3cf2 tempest-CinderUnicodeTest-1014839738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b5f0e02-c9f4-40ca-9fc4-019f6a5fa366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:46 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a59125aa-d465-4994-9e49-4fd30eaf3cf2 tempest-CinderUnicodeTest-1014839738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b5f0e02-c9f4-40ca-9fc4-019f6a5fa366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:46 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a59125aa-d465-4994-9e49-4fd30eaf3cf2 tempest-CinderUnicodeTest-1014839738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79fc227c-2f60-4d93-8b6b-b4d72f4a9c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:46 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-a59125aa-d465-4994-9e49-4fd30eaf3cf2 tempest-CinderUnicodeTest-1014839738 None] Volume 7586a088-1753-45cd-9054-1d21a930678f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7586a088-1753-45cd-9054-1d21a930678f', 'volume_size': 1} Apr 24 13:59:46 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a59125aa-d465-4994-9e49-4fd30eaf3cf2 tempest-CinderUnicodeTest-1014839738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:59:46 devstack sudo[91604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e Apr 24 13:59:46 devstack sudo[91604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:47 devstack sudo[91601]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3556bfaf-a611-4400-ab62-28e396d44590 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-45dd4b7b-670d-40b0-9c60-34fbc34a408f" returned: 0 in 0.785s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3556bfaf-a611-4400-ab62-28e396d44590 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-45dd4b7b-670d-40b0-9c60-34fbc34a408f {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:47 devstack sudo[91609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-45dd4b7b-670d-40b0-9c60-34fbc34a408f Apr 24 13:59:47 devstack sudo[91609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:47 devstack sudo[91604]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e" returned: 0 in 0.736s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:47 devstack cinder-volume[82046]: DEBUG cinder.image.image_utils [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Image conversion details: src /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e, size 1024.00 MB, duration 7.19 sec, destination /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f106ad93-380f-412d-9bc1-0f26cd5d6369 {{(pid=82046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 13:59:47 devstack cinder-volume[82046]: INFO cinder.image.image_utils [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Converted 1024.00 MB image at 142.49 MB/s Apr 24 13:59:47 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f106ad93-380f-412d-9bc1-0f26cd5d6369 is being set with open permissions: ugo+rw Apr 24 13:59:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f106ad93-380f-412d-9bc1-0f26cd5d6369 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:47 devstack sudo[91615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f106ad93-380f-412d-9bc1-0f26cd5d6369 Apr 24 13:59:47 devstack sudo[91615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:47 devstack sudo[91609]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3556bfaf-a611-4400-ab62-28e396d44590 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-45dd4b7b-670d-40b0-9c60-34fbc34a408f" returned: 0 in 0.515s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:47 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-3556bfaf-a611-4400-ab62-28e396d44590 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "cinder-quobyte-45dd4b7b-670d-40b0-9c60-34fbc34a408f" released by "delete_volume" :: held 1.397s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:59:47 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-3556bfaf-a611-4400-ab62-28e396d44590 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Created reservations ['1972ef9a-471c-461e-909c-af20a0fba918', 'fbff8fb1-2ca7-4d11-954d-9df7c952e1ba', '329378a3-3ab8-4579-a248-9bd4a61aad90', 'ea0b8cbb-bf49-4fce-b186-72ce8c406822'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:59:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-3556bfaf-a611-4400-ab62-28e396d44590 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:59:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-3556bfaf-a611-4400-ab62-28e396d44590 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:59:47 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-3556bfaf-a611-4400-ab62-28e396d44590 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:59:47 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-3556bfaf-a611-4400-ab62-28e396d44590 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:59:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-3556bfaf-a611-4400-ab62-28e396d44590 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:59:47 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3556bfaf-a611-4400-ab62-28e396d44590 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:47 devstack sudo[91617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:59:47 devstack sudo[91617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:48 devstack sudo[91615]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f106ad93-380f-412d-9bc1-0f26cd5d6369" returned: 0 in 0.508s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:48 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Lock "cinder-quobyte-f106ad93-380f-412d-9bc1-0f26cd5d6369" released by "_copy_volume_from_snapshot" :: held 9.917s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:59:48 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Acquiring lock "cinder-quobyte-caa81c2b-26c7-4867-9561-c887fc798388" by "_delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:59:48 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Lock "cinder-quobyte-caa81c2b-26c7-4867-9561-c887fc798388" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:59:48 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Deleting offline snapshot caa81c2b-26c7-4867-9561-c887fc798388 of volume f4e024a8-e590-4058-8266-9f96b0d66f4e {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 13:59:48 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] snapshot_file for this snap is: volume-f4e024a8-e590-4058-8266-9f96b0d66f4e.caa81c2b-26c7-4867-9561-c887fc798388 {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 13:59:48 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[267c2b42-baaa-4e8c-967d-1a02fd682dc9]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:59:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e.caa81c2b-26c7-4867-9561-c887fc798388 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:48 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-dfdb6956-83ab-4cd9-bdfe-e3bd7696a35e tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Acquiring lock "cinder-b935e661-9c8b-47e7-9e74-dad6a0218ae4-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:59:48 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-dfdb6956-83ab-4cd9-bdfe-e3bd7696a35e tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "cinder-b935e661-9c8b-47e7-9e74-dad6a0218ae4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:59:48 devstack sudo[91617]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-3556bfaf-a611-4400-ab62-28e396d44590 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.516s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:48 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-3556bfaf-a611-4400-ab62-28e396d44590 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:59:48 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-3556bfaf-a611-4400-ab62-28e396d44590 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Deleted volume successfully. Apr 24 13:59:48 devstack sudo[91621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e.caa81c2b-26c7-4867-9561-c887fc798388 Apr 24 13:59:48 devstack sudo[91621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:48 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-dfdb6956-83ab-4cd9-bdfe-e3bd7696a35e tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Acquiring lock "cinder-quobyte-b935e661-9c8b-47e7-9e74-dad6a0218ae4" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:59:48 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-3556bfaf-a611-4400-ab62-28e396d44590 tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "cinder-45dd4b7b-670d-40b0-9c60-34fbc34a408f-delete_volume" released by "delete_volume" :: held 2.313s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:59:48 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-dfdb6956-83ab-4cd9-bdfe-e3bd7696a35e tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "cinder-quobyte-b935e661-9c8b-47e7-9e74-dad6a0218ae4" acquired by "delete_volume" :: waited 0.027s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:59:48 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d95239-6b37-48e8-886f-79bae19c1e44]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:59:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-dfdb6956-83ab-4cd9-bdfe-e3bd7696a35e tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b935e661-9c8b-47e7-9e74-dad6a0218ae4 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:48 devstack sudo[91623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b935e661-9c8b-47e7-9e74-dad6a0218ae4 Apr 24 13:59:48 devstack sudo[91623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:48 devstack sudo[91621]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e.caa81c2b-26c7-4867-9561-c887fc798388" returned: 0 in 0.621s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:48 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4e024a8-e590-4058-8266-9f96b0d66f4e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:59:48 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca297b7d-8f76-4d54-8a67-835d8ad677e2]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:59:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:48 devstack sudo[91630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e Apr 24 13:59:48 devstack sudo[91630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:48 devstack sudo[91623]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-dfdb6956-83ab-4cd9-bdfe-e3bd7696a35e tempest-CreateVolumesFromSourceVolumeTest-103316046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b935e661-9c8b-47e7-9e74-dad6a0218ae4" returned: 0 in 0.610s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:48 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-dfdb6956-83ab-4cd9-bdfe-e3bd7696a35e tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b935e661-9c8b-47e7-9e74-dad6a0218ae4 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:48 devstack sudo[91633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b935e661-9c8b-47e7-9e74-dad6a0218ae4 Apr 24 13:59:48 devstack sudo[91633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:49 devstack sudo[91630]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e" returned: 0 in 0.639s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e.caa81c2b-26c7-4867-9561-c887fc798388 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:49 devstack sudo[91633]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-dfdb6956-83ab-4cd9-bdfe-e3bd7696a35e tempest-CreateVolumesFromSourceVolumeTest-103316046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-b935e661-9c8b-47e7-9e74-dad6a0218ae4" returned: 0 in 0.498s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:49 devstack sudo[91639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e.caa81c2b-26c7-4867-9561-c887fc798388 Apr 24 13:59:49 devstack sudo[91639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:49 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-dfdb6956-83ab-4cd9-bdfe-e3bd7696a35e tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "cinder-quobyte-b935e661-9c8b-47e7-9e74-dad6a0218ae4" released by "delete_volume" :: held 1.155s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:59:49 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-dfdb6956-83ab-4cd9-bdfe-e3bd7696a35e tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Created reservations ['1eab97d4-c2e6-4c64-b2be-a099350d35d3', 'da1caa3b-2f91-4e63-8730-da88dc302a74', '5e413f6f-a094-4a40-b833-e62dd96cdb1b', '5bc20d99-bcc3-45e7-a964-2ab522ae9377'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:59:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-dfdb6956-83ab-4cd9-bdfe-e3bd7696a35e tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:59:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-dfdb6956-83ab-4cd9-bdfe-e3bd7696a35e tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:59:49 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-dfdb6956-83ab-4cd9-bdfe-e3bd7696a35e tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:59:49 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-dfdb6956-83ab-4cd9-bdfe-e3bd7696a35e tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:59:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-dfdb6956-83ab-4cd9-bdfe-e3bd7696a35e tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:59:49 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-dfdb6956-83ab-4cd9-bdfe-e3bd7696a35e tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:49 devstack sudo[91641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:59:49 devstack sudo[91641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:49 devstack sudo[91639]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e.caa81c2b-26c7-4867-9561-c887fc798388" returned: 0 in 0.602s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e.caa81c2b-26c7-4867-9561-c887fc798388 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:50 devstack sudo[91653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e.caa81c2b-26c7-4867-9561-c887fc798388 Apr 24 13:59:50 devstack sudo[91653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:50 devstack sudo[91641]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-dfdb6956-83ab-4cd9-bdfe-e3bd7696a35e tempest-CreateVolumesFromSourceVolumeTest-103316046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.492s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:50 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-dfdb6956-83ab-4cd9-bdfe-e3bd7696a35e tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:59:50 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-dfdb6956-83ab-4cd9-bdfe-e3bd7696a35e tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Deleted volume successfully. Apr 24 13:59:50 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-dfdb6956-83ab-4cd9-bdfe-e3bd7696a35e tempest-CreateVolumesFromSourceVolumeTest-103316046 None] Lock "cinder-b935e661-9c8b-47e7-9e74-dad6a0218ae4-delete_volume" released by "delete_volume" :: held 1.929s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:59:50 devstack sudo[91653]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e.caa81c2b-26c7-4867-9561-c887fc798388" returned: 0 in 0.476s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:50 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Lock "cinder-quobyte-caa81c2b-26c7-4867-9561-c887fc798388" released by "_delete_snapshot" :: held 2.440s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:59:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.474s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:59:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 20.998s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:59:50 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] Acquiring lock "cinder-quobyte-1a1aaeec-46a1-4fba-a1e2-8216ddcd4583-e8473e3c-7ac0-494d-8edf-a97c0f45342d" by "_create_volume_from_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:59:50 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95036fec-620a-409d-b2d9-f94ef16ca9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f106ad93-380f-412d-9bc1-0f26cd5d6369', 'volume_size': 1, 'source_volid': 'f4e024a8-e590-4058-8266-9f96b0d66f4e', 'source_volstatus': 'available'}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:50 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1de11ccc-e223-4318-ad64-b4c4f7c6bff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:50 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] Lock "cinder-quobyte-1a1aaeec-46a1-4fba-a1e2-8216ddcd4583-e8473e3c-7ac0-494d-8edf-a97c0f45342d" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:59:50 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] Creating volume e8473e3c-7ac0-494d-8edf-a97c0f45342d from snapshot 1a1aaeec-46a1-4fba-a1e2-8216ddcd4583 {{(pid=82046) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 24 13:59:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:59:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:59:50 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:59:50 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:59:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:59:50 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:59:50 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] Acquiring lock "cinder-quobyte-e8473e3c-7ac0-494d-8edf-a97c0f45342d" by "_copy_volume_from_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:59:50 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Volume volume-f106ad93-380f-412d-9bc1-0f26cd5d6369 (f106ad93-380f-412d-9bc1-0f26cd5d6369): created successfully Apr 24 13:59:50 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1de11ccc-e223-4318-ad64-b4c4f7c6bff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:50 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Flow 'volume_create_manager' (25afa539-8589-4938-9dd7-4661febe9a19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:59:50 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] Lock "cinder-quobyte-e8473e3c-7ac0-494d-8edf-a97c0f45342d" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:59:50 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] snapshot: 1a1aaeec-46a1-4fba-a1e2-8216ddcd4583, volume: e8473e3c-7ac0-494d-8edf-a97c0f45342d, {{(pid=82046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 24 13:59:50 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-e68b26f0-de3e-48d4-8b6d-c974712da4db tempest-VolumeDependencyTests-1150031044 None] Created volume successfully. Apr 24 13:59:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:59:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:59:50 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:59:50 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:59:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:59:50 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[0edf1e1a-517e-4922-9dcc-1d31a01de450]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:59:50 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7.1a1aaeec-46a1-4fba-a1e2-8216ddcd4583 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:50 devstack sudo[91656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7.1a1aaeec-46a1-4fba-a1e2-8216ddcd4583 Apr 24 13:59:50 devstack sudo[91656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:51 devstack sudo[91656]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7.1a1aaeec-46a1-4fba-a1e2-8216ddcd4583" returned: 0 in 0.728s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:51 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 13:59:51 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7 {{(pid=82046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 24 13:59:51 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] Creating direct copy from snapshot {{(pid=82046) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 24 13:59:51 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b74b594-fbf7-49c6-92fe-ea47ce38ce2a]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:59:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:51 devstack sudo[91661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7 Apr 24 13:59:51 devstack sudo[91661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:51 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d47779fa-2876-4310-b205-a198bf50f8aa tempest-VolumeDependencyTests-1150031044 None] Acquiring lock "cinder-f4e024a8-e590-4058-8266-9f96b0d66f4e-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:59:51 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d47779fa-2876-4310-b205-a198bf50f8aa tempest-VolumeDependencyTests-1150031044 None] Lock "cinder-f4e024a8-e590-4058-8266-9f96b0d66f4e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:59:51 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d47779fa-2876-4310-b205-a198bf50f8aa tempest-VolumeDependencyTests-1150031044 None] Acquiring lock "cinder-quobyte-f4e024a8-e590-4058-8266-9f96b0d66f4e" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:59:51 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d47779fa-2876-4310-b205-a198bf50f8aa tempest-VolumeDependencyTests-1150031044 None] Lock "cinder-quobyte-f4e024a8-e590-4058-8266-9f96b0d66f4e" acquired by "delete_volume" :: waited 0.020s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:59:51 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5daff45-3830-461e-a77e-ead74c346e44]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:59:51 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d47779fa-2876-4310-b205-a198bf50f8aa tempest-VolumeDependencyTests-1150031044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:52 devstack sudo[91664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e Apr 24 13:59:52 devstack sudo[91664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:52 devstack sudo[91661]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:52 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7" returned: 0 in 0.737s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:52 devstack cinder-volume[82046]: DEBUG cinder.utils [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] Path /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e8473e3c-7ac0-494d-8edf-a97c0f45342d not found in is_blk_device check {{(pid=82046) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 24 13:59:52 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e8473e3c-7ac0-494d-8edf-a97c0f45342d {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:52 devstack sudo[91669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e8473e3c-7ac0-494d-8edf-a97c0f45342d Apr 24 13:59:52 devstack sudo[91669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:52 devstack sudo[91664]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:52 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d47779fa-2876-4310-b205-a198bf50f8aa tempest-VolumeDependencyTests-1150031044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e" returned: 0 in 0.574s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:52 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d47779fa-2876-4310-b205-a198bf50f8aa tempest-VolumeDependencyTests-1150031044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:52 devstack sudo[91674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e Apr 24 13:59:52 devstack sudo[91674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:53 devstack sudo[91674]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d47779fa-2876-4310-b205-a198bf50f8aa tempest-VolumeDependencyTests-1150031044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f4e024a8-e590-4058-8266-9f96b0d66f4e" returned: 0 in 0.590s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:53 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d47779fa-2876-4310-b205-a198bf50f8aa tempest-VolumeDependencyTests-1150031044 None] Lock "cinder-quobyte-f4e024a8-e590-4058-8266-9f96b0d66f4e" released by "delete_volume" :: held 1.257s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:59:53 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-d47779fa-2876-4310-b205-a198bf50f8aa tempest-VolumeDependencyTests-1150031044 None] Created reservations ['6f8e6384-23db-4a6d-8842-c589ded8e433', '2b8aa65b-0f73-48d5-b7d6-ce3fc0156d3d', 'ae9330b6-b5fa-42a3-98b2-57cbcf0f959a', 'fceebfde-77b7-45cd-8ff4-e4a4a7e72203'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:59:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d47779fa-2876-4310-b205-a198bf50f8aa tempest-VolumeDependencyTests-1150031044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:59:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d47779fa-2876-4310-b205-a198bf50f8aa tempest-VolumeDependencyTests-1150031044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:59:53 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-d47779fa-2876-4310-b205-a198bf50f8aa tempest-VolumeDependencyTests-1150031044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:59:53 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-d47779fa-2876-4310-b205-a198bf50f8aa tempest-VolumeDependencyTests-1150031044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:59:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d47779fa-2876-4310-b205-a198bf50f8aa tempest-VolumeDependencyTests-1150031044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:59:53 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d47779fa-2876-4310-b205-a198bf50f8aa tempest-VolumeDependencyTests-1150031044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:53 devstack sudo[91687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:59:53 devstack sudo[91687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:54 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d82b6f82-81ec-4ce2-ae92-4d729c244e5f tempest-VolumeDependencyTests-1150031044 None] Acquiring lock "cinder-f106ad93-380f-412d-9bc1-0f26cd5d6369-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:59:54 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d82b6f82-81ec-4ce2-ae92-4d729c244e5f tempest-VolumeDependencyTests-1150031044 None] Lock "cinder-f106ad93-380f-412d-9bc1-0f26cd5d6369-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:59:54 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d82b6f82-81ec-4ce2-ae92-4d729c244e5f tempest-VolumeDependencyTests-1150031044 None] Acquiring lock "cinder-quobyte-f106ad93-380f-412d-9bc1-0f26cd5d6369" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:59:54 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d82b6f82-81ec-4ce2-ae92-4d729c244e5f tempest-VolumeDependencyTests-1150031044 None] Lock "cinder-quobyte-f106ad93-380f-412d-9bc1-0f26cd5d6369" acquired by "delete_volume" :: waited 0.046s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:59:54 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[545aa63d-43e2-4785-b36b-93ab71a737d2]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:59:54 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d82b6f82-81ec-4ce2-ae92-4d729c244e5f tempest-VolumeDependencyTests-1150031044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f106ad93-380f-412d-9bc1-0f26cd5d6369 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:54 devstack sudo[91689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f106ad93-380f-412d-9bc1-0f26cd5d6369 Apr 24 13:59:54 devstack sudo[91689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:55 devstack sudo[91687]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:55 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d47779fa-2876-4310-b205-a198bf50f8aa tempest-VolumeDependencyTests-1150031044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 1.579s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:55 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-d47779fa-2876-4310-b205-a198bf50f8aa tempest-VolumeDependencyTests-1150031044 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:59:55 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-d47779fa-2876-4310-b205-a198bf50f8aa tempest-VolumeDependencyTests-1150031044 None] Deleted volume successfully. Apr 24 13:59:55 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d47779fa-2876-4310-b205-a198bf50f8aa tempest-VolumeDependencyTests-1150031044 None] Lock "cinder-f4e024a8-e590-4058-8266-9f96b0d66f4e-delete_volume" released by "delete_volume" :: held 3.290s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:59:55 devstack sudo[91689]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:55 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d82b6f82-81ec-4ce2-ae92-4d729c244e5f tempest-VolumeDependencyTests-1150031044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f106ad93-380f-412d-9bc1-0f26cd5d6369" returned: 0 in 1.500s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:55 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d82b6f82-81ec-4ce2-ae92-4d729c244e5f tempest-VolumeDependencyTests-1150031044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f106ad93-380f-412d-9bc1-0f26cd5d6369 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:55 devstack sudo[91696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f106ad93-380f-412d-9bc1-0f26cd5d6369 Apr 24 13:59:55 devstack sudo[91696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:57 devstack sudo[91696]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:57 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d82b6f82-81ec-4ce2-ae92-4d729c244e5f tempest-VolumeDependencyTests-1150031044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-f106ad93-380f-412d-9bc1-0f26cd5d6369" returned: 0 in 1.090s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:57 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d82b6f82-81ec-4ce2-ae92-4d729c244e5f tempest-VolumeDependencyTests-1150031044 None] Lock "cinder-quobyte-f106ad93-380f-412d-9bc1-0f26cd5d6369" released by "delete_volume" :: held 2.732s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:59:57 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-d82b6f82-81ec-4ce2-ae92-4d729c244e5f tempest-VolumeDependencyTests-1150031044 None] Created reservations ['babcdd4c-3754-41d0-b771-3d403c351d29', '58be5236-e282-4d2d-8ce9-4a803650616b', '046a614f-749d-4e7b-946a-c2798656b69e', '91f1d440-09a9-462a-b05b-e3d6a5dbbb4f'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:59:57 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d82b6f82-81ec-4ce2-ae92-4d729c244e5f tempest-VolumeDependencyTests-1150031044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:59:57 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d82b6f82-81ec-4ce2-ae92-4d729c244e5f tempest-VolumeDependencyTests-1150031044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:59:57 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-d82b6f82-81ec-4ce2-ae92-4d729c244e5f tempest-VolumeDependencyTests-1150031044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:59:57 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-d82b6f82-81ec-4ce2-ae92-4d729c244e5f tempest-VolumeDependencyTests-1150031044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:59:57 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d82b6f82-81ec-4ce2-ae92-4d729c244e5f tempest-VolumeDependencyTests-1150031044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:59:57 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d82b6f82-81ec-4ce2-ae92-4d729c244e5f tempest-VolumeDependencyTests-1150031044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:57 devstack sudo[91699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:59:57 devstack sudo[91699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:58 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d723af77-f6b2-4194-8b3c-f0c29210fb3e tempest-VolumeDependencyTests-1150031044 None] Acquiring lock "cinder-d68173d1-3ad0-46c2-9752-7cc2887b847d-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:59:58 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d723af77-f6b2-4194-8b3c-f0c29210fb3e tempest-VolumeDependencyTests-1150031044 None] Lock "cinder-d68173d1-3ad0-46c2-9752-7cc2887b847d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:59:58 devstack sudo[91669]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e8473e3c-7ac0-494d-8edf-a97c0f45342d" returned: 0 in 5.878s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:58 devstack sudo[91699]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:58 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d2eb27-07af-441f-810a-d379dd399fb0]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:59:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d82b6f82-81ec-4ce2-ae92-4d729c244e5f tempest-VolumeDependencyTests-1150031044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.841s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:58 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-d82b6f82-81ec-4ce2-ae92-4d729c244e5f tempest-VolumeDependencyTests-1150031044 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 13:59:58 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-d82b6f82-81ec-4ce2-ae92-4d729c244e5f tempest-VolumeDependencyTests-1150031044 None] Deleted volume successfully. Apr 24 13:59:58 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d723af77-f6b2-4194-8b3c-f0c29210fb3e tempest-VolumeDependencyTests-1150031044 None] Acquiring lock "cinder-quobyte-d68173d1-3ad0-46c2-9752-7cc2887b847d" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 13:59:58 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d82b6f82-81ec-4ce2-ae92-4d729c244e5f tempest-VolumeDependencyTests-1150031044 None] Lock "cinder-f106ad93-380f-412d-9bc1-0f26cd5d6369-delete_volume" released by "delete_volume" :: held 4.020s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:59:58 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d723af77-f6b2-4194-8b3c-f0c29210fb3e tempest-VolumeDependencyTests-1150031044 None] Lock "cinder-quobyte-d68173d1-3ad0-46c2-9752-7cc2887b847d" acquired by "delete_volume" :: waited 0.028s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 13:59:58 devstack sudo[91702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7 Apr 24 13:59:58 devstack sudo[91702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:58 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e024f36-6c14-4392-a230-c3229cd3b461]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 13:59:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d723af77-f6b2-4194-8b3c-f0c29210fb3e tempest-VolumeDependencyTests-1150031044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d68173d1-3ad0-46c2-9752-7cc2887b847d {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:58 devstack sudo[91704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d68173d1-3ad0-46c2-9752-7cc2887b847d Apr 24 13:59:58 devstack sudo[91704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:58 devstack sudo[91702]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7" returned: 0 in 0.689s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:58 devstack cinder-volume[82046]: DEBUG cinder.image.image_utils [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] Image conversion details: src /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7, size 1024.00 MB, duration 5.88 sec, destination /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e8473e3c-7ac0-494d-8edf-a97c0f45342d {{(pid=82046) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 24 13:59:58 devstack cinder-volume[82046]: INFO cinder.image.image_utils [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] Converted 1024.00 MB image at 174.18 MB/s Apr 24 13:59:58 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e8473e3c-7ac0-494d-8edf-a97c0f45342d is being set with open permissions: ugo+rw Apr 24 13:59:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e8473e3c-7ac0-494d-8edf-a97c0f45342d {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:58 devstack sudo[91712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e8473e3c-7ac0-494d-8edf-a97c0f45342d Apr 24 13:59:58 devstack sudo[91712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:58 devstack sudo[91704]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d723af77-f6b2-4194-8b3c-f0c29210fb3e tempest-VolumeDependencyTests-1150031044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d68173d1-3ad0-46c2-9752-7cc2887b847d" returned: 0 in 0.643s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:58 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d723af77-f6b2-4194-8b3c-f0c29210fb3e tempest-VolumeDependencyTests-1150031044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d68173d1-3ad0-46c2-9752-7cc2887b847d {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:58 devstack sudo[91714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d68173d1-3ad0-46c2-9752-7cc2887b847d Apr 24 13:59:58 devstack sudo[91714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:59 devstack sudo[91712]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e8473e3c-7ac0-494d-8edf-a97c0f45342d" returned: 0 in 0.502s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:59 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] Lock "cinder-quobyte-e8473e3c-7ac0-494d-8edf-a97c0f45342d" released by "_copy_volume_from_snapshot" :: held 8.674s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:59:59 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] Lock "cinder-quobyte-1a1aaeec-46a1-4fba-a1e2-8216ddcd4583-e8473e3c-7ac0-494d-8edf-a97c0f45342d" released by "_create_volume_from_snapshot" :: held 8.733s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:59:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.774s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:59:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a59125aa-d465-4994-9e49-4fd30eaf3cf2 tempest-CinderUnicodeTest-1014839738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.501s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:59:59 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a59125aa-d465-4994-9e49-4fd30eaf3cf2 tempest-CinderUnicodeTest-1014839738 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T11:59:46Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7586a088-1753-45cd-9054-1d21a930678f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e7aa19cdff642f6b69f5f081c85459a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T11:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T11:59:47Z,use_quota=True,user_id='0d62c69f78c24b669a79ae2486ea9757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 13:59:59 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-a59125aa-d465-4994-9e49-4fd30eaf3cf2 tempest-CinderUnicodeTest-1014839738 None] Creating volume 7586a088-1753-45cd-9054-1d21a930678f {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 13:59:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a59125aa-d465-4994-9e49-4fd30eaf3cf2 tempest-CinderUnicodeTest-1014839738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:59:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a59125aa-d465-4994-9e49-4fd30eaf3cf2 tempest-CinderUnicodeTest-1014839738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:59:59 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a59125aa-d465-4994-9e49-4fd30eaf3cf2 tempest-CinderUnicodeTest-1014839738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:59:59 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a59125aa-d465-4994-9e49-4fd30eaf3cf2 tempest-CinderUnicodeTest-1014839738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:59:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a59125aa-d465-4994-9e49-4fd30eaf3cf2 tempest-CinderUnicodeTest-1014839738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:59:59 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a59125aa-d465-4994-9e49-4fd30eaf3cf2 tempest-CinderUnicodeTest-1014839738 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 13:59:59 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-a59125aa-d465-4994-9e49-4fd30eaf3cf2 tempest-CinderUnicodeTest-1014839738 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 13:59:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a59125aa-d465-4994-9e49-4fd30eaf3cf2 tempest-CinderUnicodeTest-1014839738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7586a088-1753-45cd-9054-1d21a930678f 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:59 devstack sudo[91718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7586a088-1753-45cd-9054-1d21a930678f 1073741824 Apr 24 13:59:59 devstack sudo[91718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 13:59:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3abc3224-0880-4937-980d-baebc153f9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8473e3c-7ac0-494d-8edf-a97c0f45342d', 'volume_size': 1, 'snapshot_id': '1a1aaeec-46a1-4fba-a1e2-8216ddcd4583'}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5b28f59-5dcb-4045-9177-737cb48645ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 13:59:59 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] Volume volume-e8473e3c-7ac0-494d-8edf-a97c0f45342d (e8473e3c-7ac0-494d-8edf-a97c0f45342d): created successfully Apr 24 13:59:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5b28f59-5dcb-4045-9177-737cb48645ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 13:59:59 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] Flow 'volume_create_manager' (f57ec908-8fa0-458c-b8a2-8e57bc59efbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 13:59:59 devstack sudo[91714]: pam_unix(sudo:session): session closed for user root Apr 24 13:59:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d723af77-f6b2-4194-8b3c-f0c29210fb3e tempest-VolumeDependencyTests-1150031044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-d68173d1-3ad0-46c2-9752-7cc2887b847d" returned: 0 in 0.542s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 13:59:59 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d723af77-f6b2-4194-8b3c-f0c29210fb3e tempest-VolumeDependencyTests-1150031044 None] Lock "cinder-quobyte-d68173d1-3ad0-46c2-9752-7cc2887b847d" released by "delete_volume" :: held 1.240s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 13:59:59 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-5640dddf-df3f-48b9-a9da-8d7307117bdf tempest-SnapshotDependencyTests-704110802 None] Created volume successfully. Apr 24 13:59:59 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-d723af77-f6b2-4194-8b3c-f0c29210fb3e tempest-VolumeDependencyTests-1150031044 None] Created reservations ['9450840a-63e1-4eb1-a02e-812242ae2615', 'c8762a55-9d26-47dd-93f9-ef686461aa4e', 'da3304e1-173e-4a08-8dfd-948b769eea72', '673ed32b-ecb0-43ef-816e-dc1940b73fad'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 13:59:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d723af77-f6b2-4194-8b3c-f0c29210fb3e tempest-VolumeDependencyTests-1150031044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 13:59:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d723af77-f6b2-4194-8b3c-f0c29210fb3e tempest-VolumeDependencyTests-1150031044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 13:59:59 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-d723af77-f6b2-4194-8b3c-f0c29210fb3e tempest-VolumeDependencyTests-1150031044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 13:59:59 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-d723af77-f6b2-4194-8b3c-f0c29210fb3e tempest-VolumeDependencyTests-1150031044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 13:59:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-d723af77-f6b2-4194-8b3c-f0c29210fb3e tempest-VolumeDependencyTests-1150031044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 13:59:59 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d723af77-f6b2-4194-8b3c-f0c29210fb3e tempest-VolumeDependencyTests-1150031044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 13:59:59 devstack sudo[91720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 13:59:59 devstack sudo[91720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 14:00:00 devstack sudo[91718]: pam_unix(sudo:session): session closed for user root Apr 24 14:00:00 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a59125aa-d465-4994-9e49-4fd30eaf3cf2 tempest-CinderUnicodeTest-1014839738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7586a088-1753-45cd-9054-1d21a930678f 1073741824" returned: 0 in 0.686s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 14:00:00 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a59125aa-d465-4994-9e49-4fd30eaf3cf2 tempest-CinderUnicodeTest-1014839738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7586a088-1753-45cd-9054-1d21a930678f {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 14:00:00 devstack sudo[91720]: pam_unix(sudo:session): session closed for user root Apr 24 14:00:00 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-d723af77-f6b2-4194-8b3c-f0c29210fb3e tempest-VolumeDependencyTests-1150031044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.518s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 14:00:00 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-d723af77-f6b2-4194-8b3c-f0c29210fb3e tempest-VolumeDependencyTests-1150031044 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 14:00:00 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-d723af77-f6b2-4194-8b3c-f0c29210fb3e tempest-VolumeDependencyTests-1150031044 None] Deleted volume successfully. Apr 24 14:00:00 devstack sudo[91726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7586a088-1753-45cd-9054-1d21a930678f Apr 24 14:00:00 devstack sudo[91726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 14:00:00 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-d723af77-f6b2-4194-8b3c-f0c29210fb3e tempest-VolumeDependencyTests-1150031044 None] Lock "cinder-d68173d1-3ad0-46c2-9752-7cc2887b847d-delete_volume" released by "delete_volume" :: held 2.026s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 14:00:00 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b6fa9c8b-f39f-4fa0-8532-c080530df09b tempest-SnapshotDependencyTests-704110802 None] Acquiring lock "cinder-1a1aaeec-46a1-4fba-a1e2-8216ddcd4583-delete_snapshot" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 14:00:00 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b6fa9c8b-f39f-4fa0-8532-c080530df09b tempest-SnapshotDependencyTests-704110802 None] Lock "cinder-1a1aaeec-46a1-4fba-a1e2-8216ddcd4583-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 14:00:00 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b6fa9c8b-f39f-4fa0-8532-c080530df09b tempest-SnapshotDependencyTests-704110802 None] Acquiring lock "cinder-quobyte-75233b5d-1a06-4fcc-a057-5d525e7af8e7" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 14:00:00 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b6fa9c8b-f39f-4fa0-8532-c080530df09b tempest-SnapshotDependencyTests-704110802 None] Lock "cinder-quobyte-75233b5d-1a06-4fcc-a057-5d525e7af8e7" acquired by "delete_snapshot" :: waited 0.037s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 14:00:00 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b6fa9c8b-f39f-4fa0-8532-c080530df09b tempest-SnapshotDependencyTests-704110802 None] Acquiring lock "cinder-quobyte-1a1aaeec-46a1-4fba-a1e2-8216ddcd4583" by "_delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 14:00:00 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b6fa9c8b-f39f-4fa0-8532-c080530df09b tempest-SnapshotDependencyTests-704110802 None] Lock "cinder-quobyte-1a1aaeec-46a1-4fba-a1e2-8216ddcd4583" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 14:00:00 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-b6fa9c8b-f39f-4fa0-8532-c080530df09b tempest-SnapshotDependencyTests-704110802 None] Deleting offline snapshot 1a1aaeec-46a1-4fba-a1e2-8216ddcd4583 of volume 75233b5d-1a06-4fcc-a057-5d525e7af8e7 {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 14:00:00 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-b6fa9c8b-f39f-4fa0-8532-c080530df09b tempest-SnapshotDependencyTests-704110802 None] snapshot_file for this snap is: volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7.1a1aaeec-46a1-4fba-a1e2-8216ddcd4583 {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 14:00:00 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[059be437-9db5-49a3-9393-701a098151fc]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 14:00:00 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b6fa9c8b-f39f-4fa0-8532-c080530df09b tempest-SnapshotDependencyTests-704110802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7.1a1aaeec-46a1-4fba-a1e2-8216ddcd4583 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 14:00:00 devstack sudo[91729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7.1a1aaeec-46a1-4fba-a1e2-8216ddcd4583 Apr 24 14:00:00 devstack sudo[91729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 14:00:00 devstack sudo[91726]: pam_unix(sudo:session): session closed for user root Apr 24 14:00:00 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-a59125aa-d465-4994-9e49-4fd30eaf3cf2 tempest-CinderUnicodeTest-1014839738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7586a088-1753-45cd-9054-1d21a930678f" returned: 0 in 0.646s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 14:00:00 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-a59125aa-d465-4994-9e49-4fd30eaf3cf2 tempest-CinderUnicodeTest-1014839738 None] <== create_volume: return (1374ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 14:00:00 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-a59125aa-d465-4994-9e49-4fd30eaf3cf2 tempest-CinderUnicodeTest-1014839738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.378s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 14:00:00 devstack cinder-volume[82046]: DEBUG dbcounter [-] [82046] Writing DB stats cinder:SELECT=139,cinder:UPDATE=200,cinder:INSERT=49,cinder:DELETE=15 {{(pid=82046) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 14:00:00 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a59125aa-d465-4994-9e49-4fd30eaf3cf2 tempest-CinderUnicodeTest-1014839738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79fc227c-2f60-4d93-8b6b-b4d72f4a9c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7586a088-1753-45cd-9054-1d21a930678f', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 14:00:00 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a59125aa-d465-4994-9e49-4fd30eaf3cf2 tempest-CinderUnicodeTest-1014839738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcf5689d-3e5b-493c-bdde-dbac3e682c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 14:00:00 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-a59125aa-d465-4994-9e49-4fd30eaf3cf2 tempest-CinderUnicodeTest-1014839738 None] Volume volume-7586a088-1753-45cd-9054-1d21a930678f (7586a088-1753-45cd-9054-1d21a930678f): created successfully Apr 24 14:00:00 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a59125aa-d465-4994-9e49-4fd30eaf3cf2 tempest-CinderUnicodeTest-1014839738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcf5689d-3e5b-493c-bdde-dbac3e682c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 14:00:00 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-a59125aa-d465-4994-9e49-4fd30eaf3cf2 tempest-CinderUnicodeTest-1014839738 None] Flow 'volume_create_manager' (319ca6b1-31a0-43d3-a776-a11fb6fc6a79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 14:00:00 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-a59125aa-d465-4994-9e49-4fd30eaf3cf2 tempest-CinderUnicodeTest-1014839738 None] Created volume successfully. Apr 24 14:00:01 devstack sudo[91729]: pam_unix(sudo:session): session closed for user root Apr 24 14:00:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b6fa9c8b-f39f-4fa0-8532-c080530df09b tempest-SnapshotDependencyTests-704110802 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7.1a1aaeec-46a1-4fba-a1e2-8216ddcd4583" returned: 0 in 0.710s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 14:00:01 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-b6fa9c8b-f39f-4fa0-8532-c080530df09b tempest-SnapshotDependencyTests-704110802 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 14:00:01 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[b556ffa6-de2b-4243-bcbe-b261805b1eeb]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 14:00:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b6fa9c8b-f39f-4fa0-8532-c080530df09b tempest-SnapshotDependencyTests-704110802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 14:00:01 devstack sudo[91734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7 Apr 24 14:00:01 devstack sudo[91734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 14:00:01 devstack cinder-volume[82046]: DEBUG cinder.volume.flows.manager.create_volume [None req-0796ec5f-9bc7-4edb-a2e9-aa55ef2ea3a1 tempest-CinderUnicodeTest-1014839738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82046) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 24 14:00:01 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0796ec5f-9bc7-4edb-a2e9-aa55ef2ea3a1 tempest-CinderUnicodeTest-1014839738 None] Flow 'volume_create_manager' (1f0140e0-33ff-4456-b1df-35af08c8bfc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 14:00:01 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0796ec5f-9bc7-4edb-a2e9-aa55ef2ea3a1 tempest-CinderUnicodeTest-1014839738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf131883-2991-4f5c-9d1a-5b19d8e0ed0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 14:00:01 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0796ec5f-9bc7-4edb-a2e9-aa55ef2ea3a1 tempest-CinderUnicodeTest-1014839738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf131883-2991-4f5c-9d1a-5b19d8e0ed0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T12:00:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-878260718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e2cef79-d25c-4c16-ba79-37a7a970e655,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e7aa19cdff642f6b69f5f081c85459a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:00:02Z,use_quota=True,user_id='0d62c69f78c24b669a79ae2486ea9757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 14:00:01 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0796ec5f-9bc7-4edb-a2e9-aa55ef2ea3a1 tempest-CinderUnicodeTest-1014839738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (780ab56a-5f53-4c54-8b93-0ce95919d742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 14:00:01 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0796ec5f-9bc7-4edb-a2e9-aa55ef2ea3a1 tempest-CinderUnicodeTest-1014839738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (780ab56a-5f53-4c54-8b93-0ce95919d742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 14:00:01 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0796ec5f-9bc7-4edb-a2e9-aa55ef2ea3a1 tempest-CinderUnicodeTest-1014839738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebe25003-826f-458c-b2c9-c5854bd41f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 14:00:01 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0796ec5f-9bc7-4edb-a2e9-aa55ef2ea3a1 tempest-CinderUnicodeTest-1014839738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebe25003-826f-458c-b2c9-c5854bd41f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e2cef79-d25c-4c16-ba79-37a7a970e655', 'volume_name': 'volume-6e2cef79-d25c-4c16-ba79-37a7a970e655', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 14:00:01 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0796ec5f-9bc7-4edb-a2e9-aa55ef2ea3a1 tempest-CinderUnicodeTest-1014839738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f843b675-f2d9-4b1d-9a1c-77e799e6f880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 14:00:01 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0796ec5f-9bc7-4edb-a2e9-aa55ef2ea3a1 tempest-CinderUnicodeTest-1014839738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f843b675-f2d9-4b1d-9a1c-77e799e6f880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 14:00:01 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0796ec5f-9bc7-4edb-a2e9-aa55ef2ea3a1 tempest-CinderUnicodeTest-1014839738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b780619-b6c5-4a3d-8649-b8ddc586e8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 14:00:01 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-0796ec5f-9bc7-4edb-a2e9-aa55ef2ea3a1 tempest-CinderUnicodeTest-1014839738 None] Volume 6e2cef79-d25c-4c16-ba79-37a7a970e655: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e2cef79-d25c-4c16-ba79-37a7a970e655', 'volume_size': 1} Apr 24 14:00:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0796ec5f-9bc7-4edb-a2e9-aa55ef2ea3a1 tempest-CinderUnicodeTest-1014839738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 14:00:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0796ec5f-9bc7-4edb-a2e9-aa55ef2ea3a1 tempest-CinderUnicodeTest-1014839738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 14:00:01 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-0796ec5f-9bc7-4edb-a2e9-aa55ef2ea3a1 tempest-CinderUnicodeTest-1014839738 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-24T12:00:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-878260718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e2cef79-d25c-4c16-ba79-37a7a970e655,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e7aa19cdff642f6b69f5f081c85459a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-24T12:00:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-24T12:00:02Z,use_quota=True,user_id='0d62c69f78c24b669a79ae2486ea9757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58ecbcbb-78c4-4778-81e7-444bec248a56),volume_type_id=58ecbcbb-78c4-4778-81e7-444bec248a56)}" {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 24 14:00:01 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-0796ec5f-9bc7-4edb-a2e9-aa55ef2ea3a1 tempest-CinderUnicodeTest-1014839738 None] Creating volume 6e2cef79-d25c-4c16-ba79-37a7a970e655 {{(pid=82046) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 24 14:00:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0796ec5f-9bc7-4edb-a2e9-aa55ef2ea3a1 tempest-CinderUnicodeTest-1014839738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 14:00:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0796ec5f-9bc7-4edb-a2e9-aa55ef2ea3a1 tempest-CinderUnicodeTest-1014839738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 14:00:01 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-0796ec5f-9bc7-4edb-a2e9-aa55ef2ea3a1 tempest-CinderUnicodeTest-1014839738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 14:00:01 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-0796ec5f-9bc7-4edb-a2e9-aa55ef2ea3a1 tempest-CinderUnicodeTest-1014839738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 14:00:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0796ec5f-9bc7-4edb-a2e9-aa55ef2ea3a1 tempest-CinderUnicodeTest-1014839738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 14:00:01 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-0796ec5f-9bc7-4edb-a2e9-aa55ef2ea3a1 tempest-CinderUnicodeTest-1014839738 None] Selected osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 as target Quobyte volume. {{(pid=82046) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 24 14:00:01 devstack cinder-volume[82046]: INFO cinder.volume.drivers.remotefs [None req-0796ec5f-9bc7-4edb-a2e9-aa55ef2ea3a1 tempest-CinderUnicodeTest-1014839738 None] casted to osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23 Apr 24 14:00:01 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0796ec5f-9bc7-4edb-a2e9-aa55ef2ea3a1 tempest-CinderUnicodeTest-1014839738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-6e2cef79-d25c-4c16-ba79-37a7a970e655 1073741824 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 14:00:01 devstack sudo[91736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-6e2cef79-d25c-4c16-ba79-37a7a970e655 1073741824 Apr 24 14:00:01 devstack sudo[91736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 14:00:02 devstack sudo[91734]: pam_unix(sudo:session): session closed for user root Apr 24 14:00:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b6fa9c8b-f39f-4fa0-8532-c080530df09b tempest-SnapshotDependencyTests-704110802 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7" returned: 0 in 0.698s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 14:00:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b6fa9c8b-f39f-4fa0-8532-c080530df09b tempest-SnapshotDependencyTests-704110802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7.1a1aaeec-46a1-4fba-a1e2-8216ddcd4583 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 14:00:02 devstack sudo[91741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7.1a1aaeec-46a1-4fba-a1e2-8216ddcd4583 Apr 24 14:00:02 devstack sudo[91741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 14:00:02 devstack sudo[91736]: pam_unix(sudo:session): session closed for user root Apr 24 14:00:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0796ec5f-9bc7-4edb-a2e9-aa55ef2ea3a1 tempest-CinderUnicodeTest-1014839738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-6e2cef79-d25c-4c16-ba79-37a7a970e655 1073741824" returned: 0 in 0.841s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 14:00:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0796ec5f-9bc7-4edb-a2e9-aa55ef2ea3a1 tempest-CinderUnicodeTest-1014839738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-6e2cef79-d25c-4c16-ba79-37a7a970e655 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 14:00:02 devstack sudo[91741]: pam_unix(sudo:session): session closed for user root Apr 24 14:00:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b6fa9c8b-f39f-4fa0-8532-c080530df09b tempest-SnapshotDependencyTests-704110802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7.1a1aaeec-46a1-4fba-a1e2-8216ddcd4583" returned: 0 in 0.707s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 14:00:02 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b6fa9c8b-f39f-4fa0-8532-c080530df09b tempest-SnapshotDependencyTests-704110802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7.1a1aaeec-46a1-4fba-a1e2-8216ddcd4583 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 14:00:02 devstack sudo[91749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-6e2cef79-d25c-4c16-ba79-37a7a970e655 Apr 24 14:00:02 devstack sudo[91749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 14:00:02 devstack sudo[91751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7.1a1aaeec-46a1-4fba-a1e2-8216ddcd4583 Apr 24 14:00:02 devstack sudo[91751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 14:00:03 devstack sudo[91749]: pam_unix(sudo:session): session closed for user root Apr 24 14:00:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-0796ec5f-9bc7-4edb-a2e9-aa55ef2ea3a1 tempest-CinderUnicodeTest-1014839738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-6e2cef79-d25c-4c16-ba79-37a7a970e655" returned: 0 in 0.493s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 14:00:03 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-0796ec5f-9bc7-4edb-a2e9-aa55ef2ea3a1 tempest-CinderUnicodeTest-1014839738 None] <== create_volume: return (1383ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'} {{(pid=82046) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 24 14:00:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-0796ec5f-9bc7-4edb-a2e9-aa55ef2ea3a1 tempest-CinderUnicodeTest-1014839738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.387s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 14:00:03 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0796ec5f-9bc7-4edb-a2e9-aa55ef2ea3a1 tempest-CinderUnicodeTest-1014839738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b780619-b6c5-4a3d-8649-b8ddc586e8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e2cef79-d25c-4c16-ba79-37a7a970e655', 'volume_size': 1}' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 14:00:03 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0796ec5f-9bc7-4edb-a2e9-aa55ef2ea3a1 tempest-CinderUnicodeTest-1014839738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7f337c7-6bef-417e-96f9-074a1aaf394c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 24 14:00:03 devstack cinder-volume[82046]: INFO cinder.volume.flows.manager.create_volume [None req-0796ec5f-9bc7-4edb-a2e9-aa55ef2ea3a1 tempest-CinderUnicodeTest-1014839738 None] Volume volume-6e2cef79-d25c-4c16-ba79-37a7a970e655 (6e2cef79-d25c-4c16-ba79-37a7a970e655): created successfully Apr 24 14:00:03 devstack sudo[91751]: pam_unix(sudo:session): session closed for user root Apr 24 14:00:03 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0796ec5f-9bc7-4edb-a2e9-aa55ef2ea3a1 tempest-CinderUnicodeTest-1014839738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7f337c7-6bef-417e-96f9-074a1aaf394c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82046) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 24 14:00:03 devstack cinder-volume[82046]: DEBUG cinder.volume.manager [None req-0796ec5f-9bc7-4edb-a2e9-aa55ef2ea3a1 tempest-CinderUnicodeTest-1014839738 None] Flow 'volume_create_manager' (1f0140e0-33ff-4456-b1df-35af08c8bfc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82046) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 24 14:00:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-b6fa9c8b-f39f-4fa0-8532-c080530df09b tempest-SnapshotDependencyTests-704110802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7.1a1aaeec-46a1-4fba-a1e2-8216ddcd4583" returned: 0 in 0.520s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 14:00:03 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-0796ec5f-9bc7-4edb-a2e9-aa55ef2ea3a1 tempest-CinderUnicodeTest-1014839738 None] Created volume successfully. Apr 24 14:00:03 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b6fa9c8b-f39f-4fa0-8532-c080530df09b tempest-SnapshotDependencyTests-704110802 None] Lock "cinder-quobyte-1a1aaeec-46a1-4fba-a1e2-8216ddcd4583" released by "_delete_snapshot" :: held 2.786s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 14:00:03 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b6fa9c8b-f39f-4fa0-8532-c080530df09b tempest-SnapshotDependencyTests-704110802 None] Lock "cinder-quobyte-75233b5d-1a06-4fcc-a057-5d525e7af8e7" released by "delete_snapshot" :: held 2.818s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 14:00:03 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-b6fa9c8b-f39f-4fa0-8532-c080530df09b tempest-SnapshotDependencyTests-704110802 None] Created reservations ['392ea783-8e16-4e00-9d3c-f47c15afc320', '51e13f17-abc2-4808-bf09-aeb8b9b1fb6d', 'c15def2a-7292-448a-83e5-02b1d0614ae6', '4a9ea123-5748-4c0c-879f-29f2a9c67bdc'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 14:00:03 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-b6fa9c8b-f39f-4fa0-8532-c080530df09b tempest-SnapshotDependencyTests-704110802 None] Delete snapshot completed successfully. Apr 24 14:00:03 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-b6fa9c8b-f39f-4fa0-8532-c080530df09b tempest-SnapshotDependencyTests-704110802 None] Lock "cinder-1a1aaeec-46a1-4fba-a1e2-8216ddcd4583-delete_snapshot" released by "delete_snapshot" :: held 3.038s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 14:00:03 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-242dcab5-b3f3-4671-b738-344770ad7e1d tempest-SnapshotDependencyTests-704110802 None] Acquiring lock "cinder-75233b5d-1a06-4fcc-a057-5d525e7af8e7-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 14:00:03 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-242dcab5-b3f3-4671-b738-344770ad7e1d tempest-SnapshotDependencyTests-704110802 None] Lock "cinder-75233b5d-1a06-4fcc-a057-5d525e7af8e7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 14:00:03 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-242dcab5-b3f3-4671-b738-344770ad7e1d tempest-SnapshotDependencyTests-704110802 None] Acquiring lock "cinder-quobyte-75233b5d-1a06-4fcc-a057-5d525e7af8e7" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 14:00:03 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-242dcab5-b3f3-4671-b738-344770ad7e1d tempest-SnapshotDependencyTests-704110802 None] Lock "cinder-quobyte-75233b5d-1a06-4fcc-a057-5d525e7af8e7" acquired by "delete_volume" :: waited 0.016s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 14:00:03 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[df81f2b4-f5fc-4b26-8bbd-cfe455ec4c12]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 14:00:03 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-242dcab5-b3f3-4671-b738-344770ad7e1d tempest-SnapshotDependencyTests-704110802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 14:00:03 devstack sudo[91755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7 Apr 24 14:00:03 devstack sudo[91755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 14:00:04 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-2cb490e9-fa15-4d93-bdcd-03899bbe75ed tempest-CinderUnicodeTest-1014839738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 14:00:04 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-2cb490e9-fa15-4d93-bdcd-03899bbe75ed tempest-CinderUnicodeTest-1014839738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 14:00:04 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-2cb490e9-fa15-4d93-bdcd-03899bbe75ed tempest-CinderUnicodeTest-1014839738 None] Creating offline snapshot bf62158d-8a84-4a17-acc1-a29e1b78e1d1 of volume 6e2cef79-d25c-4c16-ba79-37a7a970e655 {{(pid=82046) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 24 14:00:04 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[533fc759-dc5e-484c-baed-3dda437ea75c]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 14:00:04 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2cb490e9-fa15-4d93-bdcd-03899bbe75ed tempest-CinderUnicodeTest-1014839738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-6e2cef79-d25c-4c16-ba79-37a7a970e655 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 14:00:04 devstack sudo[91757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-6e2cef79-d25c-4c16-ba79-37a7a970e655 Apr 24 14:00:04 devstack sudo[91757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 14:00:04 devstack sudo[91755]: pam_unix(sudo:session): session closed for user root Apr 24 14:00:04 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-242dcab5-b3f3-4671-b738-344770ad7e1d tempest-SnapshotDependencyTests-704110802 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7" returned: 0 in 0.645s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 14:00:04 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-242dcab5-b3f3-4671-b738-344770ad7e1d tempest-SnapshotDependencyTests-704110802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 14:00:04 devstack sudo[91762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7 Apr 24 14:00:04 devstack sudo[91762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 14:00:04 devstack sudo[91757]: pam_unix(sudo:session): session closed for user root Apr 24 14:00:04 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2cb490e9-fa15-4d93-bdcd-03899bbe75ed tempest-CinderUnicodeTest-1014839738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-6e2cef79-d25c-4c16-ba79-37a7a970e655" returned: 0 in 0.578s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 14:00:04 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2cb490e9-fa15-4d93-bdcd-03899bbe75ed tempest-CinderUnicodeTest-1014839738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-6e2cef79-d25c-4c16-ba79-37a7a970e655,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-6e2cef79-d25c-4c16-ba79-37a7a970e655.bf62158d-8a84-4a17-acc1-a29e1b78e1d1 1G {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 14:00:04 devstack sudo[91767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-6e2cef79-d25c-4c16-ba79-37a7a970e655,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-6e2cef79-d25c-4c16-ba79-37a7a970e655.bf62158d-8a84-4a17-acc1-a29e1b78e1d1 1G Apr 24 14:00:04 devstack sudo[91767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 14:00:04 devstack sudo[91762]: pam_unix(sudo:session): session closed for user root Apr 24 14:00:04 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-242dcab5-b3f3-4671-b738-344770ad7e1d tempest-SnapshotDependencyTests-704110802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-75233b5d-1a06-4fcc-a057-5d525e7af8e7" returned: 0 in 0.498s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 14:00:04 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-242dcab5-b3f3-4671-b738-344770ad7e1d tempest-SnapshotDependencyTests-704110802 None] Lock "cinder-quobyte-75233b5d-1a06-4fcc-a057-5d525e7af8e7" released by "delete_volume" :: held 1.208s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 14:00:05 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-242dcab5-b3f3-4671-b738-344770ad7e1d tempest-SnapshotDependencyTests-704110802 None] Created reservations ['086bd06b-5d97-4867-a2b1-51905f3d3cc9', '76f1f5f0-f3a5-4373-9ec1-0cd54233389c', 'b252fc49-b218-4321-bbf0-6d66b672e3a7', 'ce03aa29-3cad-4f22-8808-e3b21c7f11b4'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 14:00:05 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-242dcab5-b3f3-4671-b738-344770ad7e1d tempest-SnapshotDependencyTests-704110802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 14:00:05 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-242dcab5-b3f3-4671-b738-344770ad7e1d tempest-SnapshotDependencyTests-704110802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 14:00:05 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-242dcab5-b3f3-4671-b738-344770ad7e1d tempest-SnapshotDependencyTests-704110802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 14:00:05 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-242dcab5-b3f3-4671-b738-344770ad7e1d tempest-SnapshotDependencyTests-704110802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 14:00:05 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-242dcab5-b3f3-4671-b738-344770ad7e1d tempest-SnapshotDependencyTests-704110802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 14:00:05 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-242dcab5-b3f3-4671-b738-344770ad7e1d tempest-SnapshotDependencyTests-704110802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 14:00:05 devstack sudo[91770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 14:00:05 devstack sudo[91770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 14:00:05 devstack sudo[91767]: pam_unix(sudo:session): session closed for user root Apr 24 14:00:05 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2cb490e9-fa15-4d93-bdcd-03899bbe75ed tempest-CinderUnicodeTest-1014839738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-6e2cef79-d25c-4c16-ba79-37a7a970e655,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-6e2cef79-d25c-4c16-ba79-37a7a970e655.bf62158d-8a84-4a17-acc1-a29e1b78e1d1 1G" returned: 0 in 0.676s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 14:00:05 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2cb490e9-fa15-4d93-bdcd-03899bbe75ed tempest-CinderUnicodeTest-1014839738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e2cef79-d25c-4c16-ba79-37a7a970e655 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-6e2cef79-d25c-4c16-ba79-37a7a970e655.bf62158d-8a84-4a17-acc1-a29e1b78e1d1 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 14:00:05 devstack sudo[91775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e2cef79-d25c-4c16-ba79-37a7a970e655 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-6e2cef79-d25c-4c16-ba79-37a7a970e655.bf62158d-8a84-4a17-acc1-a29e1b78e1d1 Apr 24 14:00:05 devstack sudo[91775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 14:00:05 devstack sudo[91770]: pam_unix(sudo:session): session closed for user root Apr 24 14:00:05 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-242dcab5-b3f3-4671-b738-344770ad7e1d tempest-SnapshotDependencyTests-704110802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.537s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 14:00:05 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-242dcab5-b3f3-4671-b738-344770ad7e1d tempest-SnapshotDependencyTests-704110802 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 14:00:05 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-242dcab5-b3f3-4671-b738-344770ad7e1d tempest-SnapshotDependencyTests-704110802 None] Deleted volume successfully. Apr 24 14:00:05 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-242dcab5-b3f3-4671-b738-344770ad7e1d tempest-SnapshotDependencyTests-704110802 None] Lock "cinder-75233b5d-1a06-4fcc-a057-5d525e7af8e7-delete_volume" released by "delete_volume" :: held 1.963s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 14:00:05 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-89307fd5-39e3-41dc-b36d-5540ad20c12d tempest-SnapshotDependencyTests-704110802 None] Acquiring lock "cinder-e8473e3c-7ac0-494d-8edf-a97c0f45342d-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 14:00:05 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-89307fd5-39e3-41dc-b36d-5540ad20c12d tempest-SnapshotDependencyTests-704110802 None] Lock "cinder-e8473e3c-7ac0-494d-8edf-a97c0f45342d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 14:00:05 devstack sudo[91775]: pam_unix(sudo:session): session closed for user root Apr 24 14:00:05 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2cb490e9-fa15-4d93-bdcd-03899bbe75ed tempest-CinderUnicodeTest-1014839738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e2cef79-d25c-4c16-ba79-37a7a970e655 -F qcow2 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-6e2cef79-d25c-4c16-ba79-37a7a970e655.bf62158d-8a84-4a17-acc1-a29e1b78e1d1" returned: 0 in 0.518s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 14:00:05 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-2cb490e9-fa15-4d93-bdcd-03899bbe75ed tempest-CinderUnicodeTest-1014839738 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-6e2cef79-d25c-4c16-ba79-37a7a970e655.bf62158d-8a84-4a17-acc1-a29e1b78e1d1 is being set with open permissions: ugo+rw Apr 24 14:00:05 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2cb490e9-fa15-4d93-bdcd-03899bbe75ed tempest-CinderUnicodeTest-1014839738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-6e2cef79-d25c-4c16-ba79-37a7a970e655.bf62158d-8a84-4a17-acc1-a29e1b78e1d1 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 14:00:05 devstack sudo[91782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-6e2cef79-d25c-4c16-ba79-37a7a970e655.bf62158d-8a84-4a17-acc1-a29e1b78e1d1 Apr 24 14:00:05 devstack sudo[91782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 14:00:05 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-89307fd5-39e3-41dc-b36d-5540ad20c12d tempest-SnapshotDependencyTests-704110802 None] Acquiring lock "cinder-quobyte-e8473e3c-7ac0-494d-8edf-a97c0f45342d" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 14:00:05 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-89307fd5-39e3-41dc-b36d-5540ad20c12d tempest-SnapshotDependencyTests-704110802 None] Lock "cinder-quobyte-e8473e3c-7ac0-494d-8edf-a97c0f45342d" acquired by "delete_volume" :: waited 0.017s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 14:00:06 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f564b1b-52bb-4f34-8762-8f34264fd733]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 14:00:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-89307fd5-39e3-41dc-b36d-5540ad20c12d tempest-SnapshotDependencyTests-704110802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e8473e3c-7ac0-494d-8edf-a97c0f45342d {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 14:00:06 devstack sudo[91784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e8473e3c-7ac0-494d-8edf-a97c0f45342d Apr 24 14:00:06 devstack sudo[91784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 14:00:06 devstack sudo[91782]: pam_unix(sudo:session): session closed for user root Apr 24 14:00:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2cb490e9-fa15-4d93-bdcd-03899bbe75ed tempest-CinderUnicodeTest-1014839738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-6e2cef79-d25c-4c16-ba79-37a7a970e655.bf62158d-8a84-4a17-acc1-a29e1b78e1d1" returned: 0 in 0.470s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 14:00:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2cb490e9-fa15-4d93-bdcd-03899bbe75ed tempest-CinderUnicodeTest-1014839738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-6e2cef79-d25c-4c16-ba79-37a7a970e655.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 14:00:06 devstack sudo[91787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-6e2cef79-d25c-4c16-ba79-37a7a970e655.info Apr 24 14:00:06 devstack sudo[91787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 14:00:06 devstack sudo[91784]: pam_unix(sudo:session): session closed for user root Apr 24 14:00:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-89307fd5-39e3-41dc-b36d-5540ad20c12d tempest-SnapshotDependencyTests-704110802 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e8473e3c-7ac0-494d-8edf-a97c0f45342d" returned: 0 in 0.585s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 14:00:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-89307fd5-39e3-41dc-b36d-5540ad20c12d tempest-SnapshotDependencyTests-704110802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e8473e3c-7ac0-494d-8edf-a97c0f45342d {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 14:00:06 devstack sudo[91792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e8473e3c-7ac0-494d-8edf-a97c0f45342d Apr 24 14:00:06 devstack sudo[91792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 14:00:06 devstack sudo[91787]: pam_unix(sudo:session): session closed for user root Apr 24 14:00:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2cb490e9-fa15-4d93-bdcd-03899bbe75ed tempest-CinderUnicodeTest-1014839738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-6e2cef79-d25c-4c16-ba79-37a7a970e655.info" returned: 0 in 0.458s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 14:00:06 devstack cinder-volume[82046]: WARNING cinder.volume.drivers.remotefs [None req-2cb490e9-fa15-4d93-bdcd-03899bbe75ed tempest-CinderUnicodeTest-1014839738 None] /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-6e2cef79-d25c-4c16-ba79-37a7a970e655.info is being set with open permissions: ugo+rw Apr 24 14:00:06 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2cb490e9-fa15-4d93-bdcd-03899bbe75ed tempest-CinderUnicodeTest-1014839738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-6e2cef79-d25c-4c16-ba79-37a7a970e655.info {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 14:00:06 devstack sudo[91795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-6e2cef79-d25c-4c16-ba79-37a7a970e655.info Apr 24 14:00:06 devstack sudo[91795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 14:00:07 devstack sudo[91792]: pam_unix(sudo:session): session closed for user root Apr 24 14:00:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-89307fd5-39e3-41dc-b36d-5540ad20c12d tempest-SnapshotDependencyTests-704110802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-e8473e3c-7ac0-494d-8edf-a97c0f45342d" returned: 0 in 0.489s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 14:00:07 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-89307fd5-39e3-41dc-b36d-5540ad20c12d tempest-SnapshotDependencyTests-704110802 None] Lock "cinder-quobyte-e8473e3c-7ac0-494d-8edf-a97c0f45342d" released by "delete_volume" :: held 1.122s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 14:00:07 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-89307fd5-39e3-41dc-b36d-5540ad20c12d tempest-SnapshotDependencyTests-704110802 None] Created reservations ['bc6b3c4f-b979-41df-9aaa-98bf4e1f939d', 'bac06d72-d9ea-4f60-87e3-bf09f075a2f7', '265de1cf-f2ed-4aab-86b7-5290f8524336', 'f7d902b7-e614-4a0a-8460-1d14db4fb6cd'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 14:00:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-89307fd5-39e3-41dc-b36d-5540ad20c12d tempest-SnapshotDependencyTests-704110802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 14:00:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-89307fd5-39e3-41dc-b36d-5540ad20c12d tempest-SnapshotDependencyTests-704110802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 14:00:07 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-89307fd5-39e3-41dc-b36d-5540ad20c12d tempest-SnapshotDependencyTests-704110802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 14:00:07 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-89307fd5-39e3-41dc-b36d-5540ad20c12d tempest-SnapshotDependencyTests-704110802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 14:00:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-89307fd5-39e3-41dc-b36d-5540ad20c12d tempest-SnapshotDependencyTests-704110802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 14:00:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-89307fd5-39e3-41dc-b36d-5540ad20c12d tempest-SnapshotDependencyTests-704110802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 14:00:07 devstack sudo[91798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 14:00:07 devstack sudo[91798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 14:00:07 devstack sudo[91795]: pam_unix(sudo:session): session closed for user root Apr 24 14:00:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-2cb490e9-fa15-4d93-bdcd-03899bbe75ed tempest-CinderUnicodeTest-1014839738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-6e2cef79-d25c-4c16-ba79-37a7a970e655.info" returned: 0 in 0.480s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 14:00:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-2cb490e9-fa15-4d93-bdcd-03899bbe75ed tempest-CinderUnicodeTest-1014839738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.268s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 14:00:07 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-2cb490e9-fa15-4d93-bdcd-03899bbe75ed tempest-CinderUnicodeTest-1014839738 None] Create snapshot completed successfully Apr 24 14:00:07 devstack sudo[91798]: pam_unix(sudo:session): session closed for user root Apr 24 14:00:07 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-89307fd5-39e3-41dc-b36d-5540ad20c12d tempest-SnapshotDependencyTests-704110802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.465s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 14:00:07 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-89307fd5-39e3-41dc-b36d-5540ad20c12d tempest-SnapshotDependencyTests-704110802 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 14:00:07 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-89307fd5-39e3-41dc-b36d-5540ad20c12d tempest-SnapshotDependencyTests-704110802 None] Deleted volume successfully. Apr 24 14:00:07 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-89307fd5-39e3-41dc-b36d-5540ad20c12d tempest-SnapshotDependencyTests-704110802 None] Lock "cinder-e8473e3c-7ac0-494d-8edf-a97c0f45342d-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 14:00:08 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ea3d9dbb-738e-47bd-bb44-79159a91125b tempest-CinderUnicodeTest-1014839738 None] Acquiring lock "cinder-bf62158d-8a84-4a17-acc1-a29e1b78e1d1-delete_snapshot" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 14:00:08 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ea3d9dbb-738e-47bd-bb44-79159a91125b tempest-CinderUnicodeTest-1014839738 None] Lock "cinder-bf62158d-8a84-4a17-acc1-a29e1b78e1d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 14:00:08 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ea3d9dbb-738e-47bd-bb44-79159a91125b tempest-CinderUnicodeTest-1014839738 None] Acquiring lock "cinder-quobyte-6e2cef79-d25c-4c16-ba79-37a7a970e655" by "delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 14:00:08 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ea3d9dbb-738e-47bd-bb44-79159a91125b tempest-CinderUnicodeTest-1014839738 None] Lock "cinder-quobyte-6e2cef79-d25c-4c16-ba79-37a7a970e655" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 14:00:08 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ea3d9dbb-738e-47bd-bb44-79159a91125b tempest-CinderUnicodeTest-1014839738 None] Acquiring lock "cinder-quobyte-bf62158d-8a84-4a17-acc1-a29e1b78e1d1" by "_delete_snapshot" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 14:00:08 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ea3d9dbb-738e-47bd-bb44-79159a91125b tempest-CinderUnicodeTest-1014839738 None] Lock "cinder-quobyte-bf62158d-8a84-4a17-acc1-a29e1b78e1d1" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 14:00:08 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-ea3d9dbb-738e-47bd-bb44-79159a91125b tempest-CinderUnicodeTest-1014839738 None] Deleting offline snapshot bf62158d-8a84-4a17-acc1-a29e1b78e1d1 of volume 6e2cef79-d25c-4c16-ba79-37a7a970e655 {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 24 14:00:08 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-ea3d9dbb-738e-47bd-bb44-79159a91125b tempest-CinderUnicodeTest-1014839738 None] snapshot_file for this snap is: volume-6e2cef79-d25c-4c16-ba79-37a7a970e655.bf62158d-8a84-4a17-acc1-a29e1b78e1d1 {{(pid=82046) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 24 14:00:08 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2118ab2-6645-4b2d-8689-26fe616b2811]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 14:00:08 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ea3d9dbb-738e-47bd-bb44-79159a91125b tempest-CinderUnicodeTest-1014839738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-6e2cef79-d25c-4c16-ba79-37a7a970e655.bf62158d-8a84-4a17-acc1-a29e1b78e1d1 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 14:00:08 devstack sudo[91802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-6e2cef79-d25c-4c16-ba79-37a7a970e655.bf62158d-8a84-4a17-acc1-a29e1b78e1d1 Apr 24 14:00:08 devstack sudo[91802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 14:00:09 devstack sudo[91802]: pam_unix(sudo:session): session closed for user root Apr 24 14:00:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ea3d9dbb-738e-47bd-bb44-79159a91125b tempest-CinderUnicodeTest-1014839738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-6e2cef79-d25c-4c16-ba79-37a7a970e655.bf62158d-8a84-4a17-acc1-a29e1b78e1d1" returned: 0 in 0.571s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 14:00:09 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.remotefs [None req-ea3d9dbb-738e-47bd-bb44-79159a91125b tempest-CinderUnicodeTest-1014839738 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e2cef79-d25c-4c16-ba79-37a7a970e655(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82046) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 24 14:00:09 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[c004f6a5-1cc8-464f-9c21-d5e7a6a89727]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 14:00:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ea3d9dbb-738e-47bd-bb44-79159a91125b tempest-CinderUnicodeTest-1014839738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-6e2cef79-d25c-4c16-ba79-37a7a970e655 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 14:00:09 devstack sudo[91807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-6e2cef79-d25c-4c16-ba79-37a7a970e655 Apr 24 14:00:09 devstack sudo[91807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 14:00:09 devstack sudo[91807]: pam_unix(sudo:session): session closed for user root Apr 24 14:00:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ea3d9dbb-738e-47bd-bb44-79159a91125b tempest-CinderUnicodeTest-1014839738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-6e2cef79-d25c-4c16-ba79-37a7a970e655" returned: 0 in 0.621s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 14:00:09 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ea3d9dbb-738e-47bd-bb44-79159a91125b tempest-CinderUnicodeTest-1014839738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-6e2cef79-d25c-4c16-ba79-37a7a970e655.bf62158d-8a84-4a17-acc1-a29e1b78e1d1 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 14:00:09 devstack sudo[91813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-6e2cef79-d25c-4c16-ba79-37a7a970e655.bf62158d-8a84-4a17-acc1-a29e1b78e1d1 Apr 24 14:00:09 devstack sudo[91813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 14:00:10 devstack sudo[91813]: pam_unix(sudo:session): session closed for user root Apr 24 14:00:10 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ea3d9dbb-738e-47bd-bb44-79159a91125b tempest-CinderUnicodeTest-1014839738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-6e2cef79-d25c-4c16-ba79-37a7a970e655.bf62158d-8a84-4a17-acc1-a29e1b78e1d1" returned: 0 in 0.586s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 14:00:10 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ea3d9dbb-738e-47bd-bb44-79159a91125b tempest-CinderUnicodeTest-1014839738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-6e2cef79-d25c-4c16-ba79-37a7a970e655.bf62158d-8a84-4a17-acc1-a29e1b78e1d1 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 14:00:10 devstack sudo[91818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-6e2cef79-d25c-4c16-ba79-37a7a970e655.bf62158d-8a84-4a17-acc1-a29e1b78e1d1 Apr 24 14:00:10 devstack sudo[91818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 14:00:10 devstack sudo[91818]: pam_unix(sudo:session): session closed for user root Apr 24 14:00:10 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-ea3d9dbb-738e-47bd-bb44-79159a91125b tempest-CinderUnicodeTest-1014839738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-6e2cef79-d25c-4c16-ba79-37a7a970e655.bf62158d-8a84-4a17-acc1-a29e1b78e1d1" returned: 0 in 0.477s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 14:00:10 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ea3d9dbb-738e-47bd-bb44-79159a91125b tempest-CinderUnicodeTest-1014839738 None] Lock "cinder-quobyte-bf62158d-8a84-4a17-acc1-a29e1b78e1d1" released by "_delete_snapshot" :: held 2.364s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 14:00:10 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ea3d9dbb-738e-47bd-bb44-79159a91125b tempest-CinderUnicodeTest-1014839738 None] Lock "cinder-quobyte-6e2cef79-d25c-4c16-ba79-37a7a970e655" released by "delete_snapshot" :: held 2.394s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 14:00:10 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-ea3d9dbb-738e-47bd-bb44-79159a91125b tempest-CinderUnicodeTest-1014839738 None] Created reservations ['b8e3b09a-5b1d-46ef-881a-cf2b0530c34a', '98cbdf21-7001-412f-9140-881f24769a01', '79675be1-88a0-40eb-a299-d804113ee78e', 'cef6b712-5ca9-4246-b52d-216848219792'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 14:00:10 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-ea3d9dbb-738e-47bd-bb44-79159a91125b tempest-CinderUnicodeTest-1014839738 None] Delete snapshot completed successfully. Apr 24 14:00:10 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-ea3d9dbb-738e-47bd-bb44-79159a91125b tempest-CinderUnicodeTest-1014839738 None] Lock "cinder-bf62158d-8a84-4a17-acc1-a29e1b78e1d1-delete_snapshot" released by "delete_snapshot" :: held 2.575s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 14:00:11 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e6e67268-d70c-498b-a9e4-129146c53378 tempest-CinderUnicodeTest-1014839738 None] Acquiring lock "cinder-6e2cef79-d25c-4c16-ba79-37a7a970e655-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 14:00:11 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e6e67268-d70c-498b-a9e4-129146c53378 tempest-CinderUnicodeTest-1014839738 None] Lock "cinder-6e2cef79-d25c-4c16-ba79-37a7a970e655-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 14:00:11 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e6e67268-d70c-498b-a9e4-129146c53378 tempest-CinderUnicodeTest-1014839738 None] Acquiring lock "cinder-quobyte-6e2cef79-d25c-4c16-ba79-37a7a970e655" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 14:00:11 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e6e67268-d70c-498b-a9e4-129146c53378 tempest-CinderUnicodeTest-1014839738 None] Lock "cinder-quobyte-6e2cef79-d25c-4c16-ba79-37a7a970e655" acquired by "delete_volume" :: waited 0.015s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 14:00:11 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a4d208-6045-4420-b06e-f3a02057a631]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 14:00:11 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e6e67268-d70c-498b-a9e4-129146c53378 tempest-CinderUnicodeTest-1014839738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-6e2cef79-d25c-4c16-ba79-37a7a970e655 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 14:00:11 devstack sudo[91822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-6e2cef79-d25c-4c16-ba79-37a7a970e655 Apr 24 14:00:11 devstack sudo[91822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 14:00:12 devstack sudo[91822]: pam_unix(sudo:session): session closed for user root Apr 24 14:00:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e6e67268-d70c-498b-a9e4-129146c53378 tempest-CinderUnicodeTest-1014839738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-6e2cef79-d25c-4c16-ba79-37a7a970e655" returned: 0 in 0.619s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 14:00:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e6e67268-d70c-498b-a9e4-129146c53378 tempest-CinderUnicodeTest-1014839738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-6e2cef79-d25c-4c16-ba79-37a7a970e655 {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 14:00:12 devstack sudo[91827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-6e2cef79-d25c-4c16-ba79-37a7a970e655 Apr 24 14:00:12 devstack sudo[91827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 14:00:12 devstack sudo[91827]: pam_unix(sudo:session): session closed for user root Apr 24 14:00:12 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e6e67268-d70c-498b-a9e4-129146c53378 tempest-CinderUnicodeTest-1014839738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-6e2cef79-d25c-4c16-ba79-37a7a970e655" returned: 0 in 0.532s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 14:00:12 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e6e67268-d70c-498b-a9e4-129146c53378 tempest-CinderUnicodeTest-1014839738 None] Lock "cinder-quobyte-6e2cef79-d25c-4c16-ba79-37a7a970e655" released by "delete_volume" :: held 1.211s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 14:00:12 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-e6e67268-d70c-498b-a9e4-129146c53378 tempest-CinderUnicodeTest-1014839738 None] Created reservations ['9bc521c4-32a9-4478-bd95-64b6daa9dcff', '10917e2b-4d8a-4498-8d8c-2686acdec64a', '9875ac33-b948-406b-bca7-f810a5d25ae2', '152e17d2-8264-4f87-a8fd-abe4849ece16'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 14:00:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-e6e67268-d70c-498b-a9e4-129146c53378 tempest-CinderUnicodeTest-1014839738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 14:00:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-e6e67268-d70c-498b-a9e4-129146c53378 tempest-CinderUnicodeTest-1014839738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 14:00:13 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-e6e67268-d70c-498b-a9e4-129146c53378 tempest-CinderUnicodeTest-1014839738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 14:00:13 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-e6e67268-d70c-498b-a9e4-129146c53378 tempest-CinderUnicodeTest-1014839738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 14:00:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-e6e67268-d70c-498b-a9e4-129146c53378 tempest-CinderUnicodeTest-1014839738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 14:00:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e6e67268-d70c-498b-a9e4-129146c53378 tempest-CinderUnicodeTest-1014839738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 14:00:13 devstack sudo[91831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 14:00:13 devstack sudo[91831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 14:00:13 devstack sudo[91831]: pam_unix(sudo:session): session closed for user root Apr 24 14:00:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e6e67268-d70c-498b-a9e4-129146c53378 tempest-CinderUnicodeTest-1014839738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.473s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 14:00:13 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-e6e67268-d70c-498b-a9e4-129146c53378 tempest-CinderUnicodeTest-1014839738 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 14:00:13 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-e6e67268-d70c-498b-a9e4-129146c53378 tempest-CinderUnicodeTest-1014839738 None] Deleted volume successfully. Apr 24 14:00:13 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e6e67268-d70c-498b-a9e4-129146c53378 tempest-CinderUnicodeTest-1014839738 None] Lock "cinder-6e2cef79-d25c-4c16-ba79-37a7a970e655-delete_volume" released by "delete_volume" :: held 1.953s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 14:00:13 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e64b140c-d8fe-4ccb-b69b-81d3b7a623cd tempest-CinderUnicodeTest-1014839738 None] Acquiring lock "cinder-7586a088-1753-45cd-9054-1d21a930678f-delete_volume" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 14:00:13 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e64b140c-d8fe-4ccb-b69b-81d3b7a623cd tempest-CinderUnicodeTest-1014839738 None] Lock "cinder-7586a088-1753-45cd-9054-1d21a930678f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 14:00:13 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e64b140c-d8fe-4ccb-b69b-81d3b7a623cd tempest-CinderUnicodeTest-1014839738 None] Acquiring lock "cinder-quobyte-7586a088-1753-45cd-9054-1d21a930678f" by "delete_volume" {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 24 14:00:13 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e64b140c-d8fe-4ccb-b69b-81d3b7a623cd tempest-CinderUnicodeTest-1014839738 None] Lock "cinder-quobyte-7586a088-1753-45cd-9054-1d21a930678f" acquired by "delete_volume" :: waited 0.035s {{(pid=82046) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 24 14:00:13 devstack cinder-volume[82046]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea6f6a6-c85a-4ec6-af50-204b4db4555a]: (4, 'qcow2') {{(pid=82735) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 24 14:00:13 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e64b140c-d8fe-4ccb-b69b-81d3b7a623cd tempest-CinderUnicodeTest-1014839738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7586a088-1753-45cd-9054-1d21a930678f {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 14:00:14 devstack sudo[91834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7586a088-1753-45cd-9054-1d21a930678f Apr 24 14:00:14 devstack sudo[91834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 14:00:14 devstack sudo[91834]: pam_unix(sudo:session): session closed for user root Apr 24 14:00:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e64b140c-d8fe-4ccb-b69b-81d3b7a623cd tempest-CinderUnicodeTest-1014839738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7586a088-1753-45cd-9054-1d21a930678f" returned: 0 in 0.645s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 14:00:14 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e64b140c-d8fe-4ccb-b69b-81d3b7a623cd tempest-CinderUnicodeTest-1014839738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7586a088-1753-45cd-9054-1d21a930678f {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 14:00:14 devstack sudo[91839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7586a088-1753-45cd-9054-1d21a930678f Apr 24 14:00:14 devstack sudo[91839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 14:00:15 devstack sudo[91839]: pam_unix(sudo:session): session closed for user root Apr 24 14:00:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e64b140c-d8fe-4ccb-b69b-81d3b7a623cd tempest-CinderUnicodeTest-1014839738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b/volume-7586a088-1753-45cd-9054-1d21a930678f" returned: 0 in 0.476s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 14:00:15 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e64b140c-d8fe-4ccb-b69b-81d3b7a623cd tempest-CinderUnicodeTest-1014839738 None] Lock "cinder-quobyte-7586a088-1753-45cd-9054-1d21a930678f" released by "delete_volume" :: held 1.174s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 14:00:15 devstack cinder-volume[82046]: DEBUG cinder.quota [None req-e64b140c-d8fe-4ccb-b69b-81d3b7a623cd tempest-CinderUnicodeTest-1014839738 None] Created reservations ['0b2c261c-b845-40e0-93b3-b307aafe3fdd', 'ebaa5f95-e1b4-4f7b-8ab6-455bdf5f68ed', '673cd8ce-b9c3-407a-a205-f53a5994789f', '67f2e405-dad1-4db9-b209-bf95c43a29a5'] {{(pid=82046) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 24 14:00:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-e64b140c-d8fe-4ccb-b69b-81d3b7a623cd tempest-CinderUnicodeTest-1014839738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 14:00:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-e64b140c-d8fe-4ccb-b69b-81d3b7a623cd tempest-CinderUnicodeTest-1014839738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 14:00:15 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-e64b140c-d8fe-4ccb-b69b-81d3b7a623cd tempest-CinderUnicodeTest-1014839738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 14:00:15 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-e64b140c-d8fe-4ccb-b69b-81d3b7a623cd tempest-CinderUnicodeTest-1014839738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 14:00:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-e64b140c-d8fe-4ccb-b69b-81d3b7a623cd tempest-CinderUnicodeTest-1014839738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 14:00:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e64b140c-d8fe-4ccb-b69b-81d3b7a623cd tempest-CinderUnicodeTest-1014839738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 14:00:15 devstack sudo[91843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 14:00:15 devstack sudo[91843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 14:00:15 devstack sudo[91843]: pam_unix(sudo:session): session closed for user root Apr 24 14:00:15 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-e64b140c-d8fe-4ccb-b69b-81d3b7a623cd tempest-CinderUnicodeTest-1014839738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.466s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 14:00:15 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-e64b140c-d8fe-4ccb-b69b-81d3b7a623cd tempest-CinderUnicodeTest-1014839738 None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 24 14:00:15 devstack cinder-volume[82046]: INFO cinder.volume.manager [None req-e64b140c-d8fe-4ccb-b69b-81d3b7a623cd tempest-CinderUnicodeTest-1014839738 None] Deleted volume successfully. Apr 24 14:00:15 devstack cinder-volume[82046]: DEBUG cinder.coordination [None req-e64b140c-d8fe-4ccb-b69b-81d3b7a623cd tempest-CinderUnicodeTest-1014839738 None] Lock "cinder-7586a088-1753-45cd-9054-1d21a930678f-delete_volume" released by "delete_volume" :: held 1.894s {{(pid=82046) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 24 14:00:25 devstack cinder-volume[82046]: DEBUG dbcounter [-] [82046] Writing DB stats cinder:SELECT=87,cinder:INSERT=32,cinder:UPDATE=113,cinder:DELETE=11 {{(pid=82046) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 14:00:25 devstack cinder-volume[82046]: DEBUG dbcounter [-] [82046] Writing DB stats cinder:UPDATE=53,cinder:SELECT=32,cinder:INSERT=11,cinder:DELETE=4 {{(pid=82046) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 24 14:00:37 devstack cinder-volume[82046]: DEBUG oslo_service.periodic_task [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82046) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 24 14:00:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 24 14:00:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 24 14:00:37 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23': None} {{(pid=82046) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 24 14:00:37 devstack cinder-volume[82046]: DEBUG cinder.volume.drivers.quobyte [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-06e41a70-9de9-492d-913c-bac1285d5d23'] {{(pid=82046) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 24 14:00:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.lockutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82046) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 24 14:00:37 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 24 14:00:37 devstack sudo[92092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b Apr 24 14:00:37 devstack sudo[92092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 24 14:00:38 devstack sudo[92092]: pam_unix(sudo:session): session closed for user root Apr 24 14:00:38 devstack cinder-volume[82046]: DEBUG oslo_concurrency.processutils [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4d9e49de0cc0d6e8317c4cfb688fe28b" returned: 0 in 0.500s {{(pid=82046) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 24 14:00:38 devstack cinder-volume[82046]: DEBUG cinder.manager [None req-de867863-6eef-44af-be1d-6c52ca9c51ae None None] Notifying Schedulers of capabilities ... {{(pid=82046) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}